Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4677 originally caused by: Started by upstream project "master-osmo-trx" build number 4881 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17660 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8947 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2956 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29270 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30048 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4677 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12971 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9242 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins17942626899932294298.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 11:14:59 + trial_dir_prefix=trial- + rm -rf trial-2373 trial-2373-bin.tgz trial-2373-run.tgz + trial_dir=trial-2374 + mkdir -p trial-2374 + mv open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2956.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29270.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30048.tgz osmo-stp.build-9242.tgz osmo-trx.build-4677.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2374 + cat open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2956.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29270.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30048.md5 osmo-stp.build-9242.md5 osmo-trx.build-4677.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2956.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29270.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30048.md5 osmo-stp.build-9242.md5 osmo-trx.build-4677.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2374 combinations: None trial: 'trial-2374' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2374 -------------------------------------------------------------------------------------------- 11:15:10.506591 tst trial-2374: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/log --------------------------------------------------------------------- trial-2374 nitb_sms:sysmo --------------------------------------------------------------------- 11:17:19.014547 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:17:19.019279 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 11:17:19.040880 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 11:17:19.047936 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 11:17:19.102198 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 11:17:19.123997 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 11:17:19.130988 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 11:17:19.668391 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:17:19.673519 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 11:17:19.684889 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 11:17:20.064833 tst mo_mt_sms.py: using LAC 28018 11:17:20.309804 tst mo_mt_sms.py: using RAC 223 11:17:20.432470 tst mo_mt_sms.py: using CellId 28018 11:17:20.555393 tst mo_mt_sms.py: using BVCI 28019 11:17:20.670279 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:17:20.850887 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:17:20.969082 tst mo_mt_sms.py:9: start nitb and bts... 11:17:21.186199 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:17:23.537949 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1108): Launched 11:17:23.863533 run osmo-nitb_10.42.42.2(pid=1109): Launched 11:17:24.038873 run osmo-nitb_10.42.42.2(pid=1109): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1109)] 11:17:24.171763 run osmo-nitb_10.42.42.2(pid=1109): stdout: | (launched: 2022-12-10_11:17:23.803296) 11:17:24.305356 run osmo-nitb_10.42.42.2(pid=1109): stderr: | (launched: 2022-12-10_11:17:23.851229) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:17:24.439575 run osmo-nitb_10.42.42.2(pid=1109): stdout: | (launched: 2022-12-10_11:17:23.803296) 11:17:24.568590 run osmo-nitb_10.42.42.2(pid=1109): stderr: | (launched: 2022-12-10_11:17:23.851229) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:17:24.723596 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1109) [trial-2374↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1109)] [trial-2374↪nitb_sms:sysmo↪mo_mt_sms.py:11] 11:17:24.732355 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 11:17:24.739493 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1108): Terminating (SIGTERM) 11:17:24.949955 --- ParallelTerminationStrategy: PID 1108 died... 11:17:24.971654 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1108): Terminated: ok {rc=0} 11:17:25.060155 bus /sierra_3: Setting Powered False 11:17:26.161099 bus /sierra_3: Setting Powered False 11:17:27.278848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:sysmo --------------------------------------------------------------------- 11:17:28.462105 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:17:28.466369 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 11:17:28.487590 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 11:17:28.516842 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 11:17:28.570686 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 11:17:28.591740 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 11:17:28.618611 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 11:17:29.162642 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:17:29.167899 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:17:29.178481 tst sms:sysmo: Using 1 x bts (candidates: 1) 11:17:29.216338 tst mo_mt_sms.py: using LAC 28019 11:17:29.335082 tst mo_mt_sms.py: using RAC 224 11:17:29.451301 tst mo_mt_sms.py: using CellId 28019 11:17:29.577362 tst mo_mt_sms.py: using BVCI 28020 11:17:29.695098 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:17:29.706363 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:17:29.717479 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:17:29.729028 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:17:29.740484 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:17:29.751852 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:17:29.867235 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:17:29.986803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:31.761494 run create_hlr_db(pid=1115): Launched 11:17:31.916134 bus /sierra_2: Setting Powered False 11:17:32.976747 run create_hlr_db(pid=1115): Terminated: ok {rc=0} 11:17:33.423978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1117): Launched 11:17:33.752765 run osmo-hlr_10.42.42.2(pid=1118): Launched 11:17:33.876922 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:36.461489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1130): Launched 11:17:36.787942 run osmo-stp_10.42.42.5(pid=1131): Launched 11:17:36.911402 run osmo-msc_10.42.42.6: Starting osmo-msc 11:17:42.371279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1133): Launched 11:17:42.695795 run osmo-msc_10.42.42.6(pid=1139): Launched 11:17:42.877666 run osmo-stp_10.42.42.5(pid=1131): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1131)] 11:17:43.013597 run osmo-stp_10.42.42.5(pid=1131): stdout: | (launched: 2022-12-10_11:17:36.726658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:43.149663 run osmo-stp_10.42.42.5(pid=1131): stderr: | 20221210111736921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111736922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111736922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111736922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111736925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111736925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111736925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:43.285176 run osmo-stp_10.42.42.5(pid=1131): stdout: | (launched: 2022-12-10_11:17:36.726658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:43.414016 run osmo-stp_10.42.42.5(pid=1131): stderr: | 20221210111736921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111736922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111736922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111736922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111736925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111736925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111736925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:43.568703 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1131): Process ended prematurely: osmo-stp_10.42.42.5(pid=1131) [trial-2374↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1131)] [trial-2374↪sms:sysmo↪mo_mt_sms.py:16] 11:17:43.577594 tst mo_mt_sms.py:16: Test FAILED (14.4 sec) 11:17:43.605255 run osmo-hlr_10.42.42.2(pid=1118): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1118)] 11:17:43.655252 run osmo-hlr_10.42.42.2(pid=1118): stdout: | (launched: 2022-12-10_11:17:33.692269) 11:17:43.707166 run osmo-hlr_10.42.42.2(pid=1118): stderr: | 20221210111733893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111733893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111733893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111733893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111733893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111733893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111733905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111733915 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111733915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111733915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:43.778853 run osmo-msc_10.42.42.6(pid=1139): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1139)] 11:17:43.829143 run osmo-msc_10.42.42.6(pid=1139): stdout: | (launched: 2022-12-10_11:17:42.634847) 11:17:43.880841 run osmo-msc_10.42.42.6(pid=1139): stderr: | 20221210111742962 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111742962 DLGLOBAL DEBUG validating counter group 0x7f0809653c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111742962 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111742963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111742963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111742963 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111742965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111742965 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111742965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111742965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:17:43.933591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1117): Terminating (SIGTERM) 11:17:43.975339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1130): Terminating (SIGTERM) 11:17:44.017212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1133): Terminating (SIGTERM) 11:17:44.059465 --- ParallelTerminationStrategy: PID 1117 died... 11:17:44.079231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1117): Terminated: ok {rc=0} 11:17:44.125885 --- ParallelTerminationStrategy: PID 1130 died... 11:17:44.145550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1130): Terminated: ok {rc=0} 11:17:44.191912 --- ParallelTerminationStrategy: PID 1133 died... 11:17:44.211501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1133): Terminated: ok {rc=0} 11:17:44.299910 bus /sierra_3: Setting Powered False 11:17:45.400368 bus /sierra_3: Setting Powered False 11:17:46.532314 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:sysmo --------------------------------------------------------------------- 11:17:47.763414 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:17:47.767725 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:17:47.789030 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 11:17:47.796470 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:17:47.833492 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:17:47.854547 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 11:17:47.862637 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:17:48.381831 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 11:17:48.387941 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 11:17:48.399573 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 11:17:48.437805 tst assert_extension.py: using LAC 28020 11:17:48.564852 tst assert_extension.py: using RAC 225 11:17:48.684942 tst assert_extension.py: using CellId 28020 11:17:48.802672 tst assert_extension.py: using BVCI 28021 11:17:48.912303 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 11:17:49.030798 tst assert_extension.py:10: start nitb and bts... 11:17:49.250384 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:17:49.912721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1145): Launched 11:17:50.237414 run osmo-nitb_10.42.42.2(pid=1146): Launched 11:17:50.415399 run osmo-nitb_10.42.42.2(pid=1146): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1146)] 11:17:50.559544 run osmo-nitb_10.42.42.2(pid=1146): stdout: | (launched: 2022-12-10_11:17:50.176465) 11:17:50.705790 run osmo-nitb_10.42.42.2(pid=1146): stderr: | (launched: 2022-12-10_11:17:50.224637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:17:50.851712 run osmo-nitb_10.42.42.2(pid=1146): stdout: | (launched: 2022-12-10_11:17:50.176465) 11:17:50.991771 run osmo-nitb_10.42.42.2(pid=1146): stderr: | (launched: 2022-12-10_11:17:50.224637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1146) [trial-2374↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1146)] 11:17:51.358974 tst osmo-nitb_10.42.42.2(pid=1146): stdout: | (launched: 2022-12-10_11:17:50.176465) 11:17:51.490386 tst osmo-nitb_10.42.42.2(pid=1146): stderr: | (launched: 2022-12-10_11:17:50.224637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:17:51.645517 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1146) [trial-2374↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1146)] [trial-2374↪nitb_ussd:sysmo↪assert_extension.py:12] 11:17:51.654270 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:17:51.661440 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1145): Terminating (SIGTERM) 11:17:51.873086 --- ParallelTerminationStrategy: PID 1145 died... 11:17:51.894433 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1145): Terminated: ok {rc=0} 11:17:51.982769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:sysmo --------------------------------------------------------------------- 11:17:53.148222 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:17:53.152284 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:17:53.173662 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 11:17:53.201394 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:17:53.236086 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:17:53.257457 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 11:17:53.284507 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:17:53.814628 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:sysmo assert_extension.py ---------------------------------------------- 11:17:53.820100 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:17:53.831257 tst ussd:sysmo: Using 1 x bts (candidates: 1) 11:17:53.866822 tst assert_extension.py: using LAC 28021 11:17:53.992718 tst assert_extension.py: using RAC 226 11:17:54.118007 tst assert_extension.py: using CellId 28021 11:17:54.242624 tst assert_extension.py: using BVCI 28022 11:17:54.359552 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:17:54.370578 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:17:54.381487 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:17:54.392334 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:17:54.403180 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:17:54.413951 tst ussd:sysmo: Using 1 x modem (candidates: 1) 11:17:54.531852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:55.037102 run create_hlr_db(pid=1150): Launched 11:17:55.168547 bus /sierra_2: Setting Powered False 11:17:56.232935 run create_hlr_db(pid=1150): Terminated: ok {rc=0} 11:17:56.669687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1152): Launched 11:17:56.975907 run osmo-hlr_10.42.42.2(pid=1153): Launched 11:17:57.092603 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:57.618879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1155): Launched 11:17:57.925667 run osmo-stp_10.42.42.5(pid=1156): Launched 11:17:58.041533 run osmo-msc_10.42.42.6: Starting osmo-msc 11:17:58.588320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1158): Launched 11:17:58.894202 run osmo-msc_10.42.42.6(pid=1159): Launched 11:17:59.063219 run osmo-stp_10.42.42.5(pid=1156): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1156)] 11:17:59.190820 run osmo-stp_10.42.42.5(pid=1156): stdout: | (launched: 2022-12-10_11:17:57.867122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:59.318626 run osmo-stp_10.42.42.5(pid=1156): stderr: | 20221210111758040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111758041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111758041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111758041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111758042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111758042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111758042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:59.445337 run osmo-stp_10.42.42.5(pid=1156): stdout: | (launched: 2022-12-10_11:17:57.867122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:59.566429 run osmo-stp_10.42.42.5(pid=1156): stderr: | 20221210111758040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111758041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111758041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111758041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111758042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111758042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111758042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:59.712021 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1156): Process ended prematurely: osmo-stp_10.42.42.5(pid=1156) [trial-2374↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1156)] [trial-2374↪ussd:sysmo↪assert_extension.py:17] 11:17:59.720789 tst assert_extension.py:17: Test FAILED (5.9 sec) 11:17:59.747113 run osmo-hlr_10.42.42.2(pid=1153): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1153)] 11:17:59.795870 run osmo-hlr_10.42.42.2(pid=1153): stdout: | (launched: 2022-12-10_11:17:56.918225) 11:17:59.845854 run osmo-hlr_10.42.42.2(pid=1153): stderr: | 20221210111757096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111757096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111757096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111757096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111757096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111757096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111757111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111757123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111757123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111757123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:59.915252 run osmo-msc_10.42.42.6(pid=1159): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1159)] 11:17:59.963578 run osmo-msc_10.42.42.6(pid=1159): stdout: | (launched: 2022-12-10_11:17:58.836468) 11:18:00.013648 run osmo-msc_10.42.42.6(pid=1159): stderr: | 20221210111759115 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111759116 DLGLOBAL DEBUG validating counter group 0x7f4d063b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111759116 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111759116 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111759117 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111759117 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111759119 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111759119 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111759119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111759119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:18:00.063912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1152): Terminating (SIGTERM) 11:18:00.104173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1155): Terminating (SIGTERM) 11:18:00.144546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1158): Terminating (SIGTERM) 11:18:00.185082 --- ParallelTerminationStrategy: PID 1152 died... 11:18:00.204153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1152): Terminated: ok {rc=0} 11:18:00.248914 --- ParallelTerminationStrategy: PID 1155 died... 11:18:00.267619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1155): Terminated: ok {rc=0} 11:18:00.312232 --- ParallelTerminationStrategy: PID 1158 died... 11:18:00.330908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1158): Terminated: ok {rc=0} 11:18:00.415695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:18:01.615626 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:18:01.623404 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:18:01.648378 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:18:01.679271 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:18:01.735303 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:18:01.767548 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:18:01.803835 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:18:02.335362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:18:02.391873 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:02.403516 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:18:02.461374 tst mo_mt_call.py: using LAC 28022 11:18:02.591363 tst mo_mt_call.py: using RAC 227 11:18:02.722230 tst mo_mt_call.py: using CellId 28022 11:18:02.882930 tst mo_mt_call.py: using BVCI 28023 11:18:02.997158 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:03.008443 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:03.019457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:03.031048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:03.042358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:03.053681 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:18:03.175855 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:18:03.295488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:03.810939 run create_hlr_db(pid=1164): Launched 11:18:03.944655 bus /sierra_2: Setting Powered False 11:18:05.010162 run create_hlr_db(pid=1164): Terminated: ok {rc=0} 11:18:05.454756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1166): Launched 11:18:05.766590 run osmo-hlr_10.42.42.2(pid=1167): Launched 11:18:05.884123 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:06.428487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1169): Launched 11:18:06.761367 run osmo-stp_10.42.42.5(pid=1170): Launched 11:18:06.886230 run osmo-msc_10.42.42.6: Starting osmo-msc 11:18:07.480348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1172): Launched 11:18:07.814409 run osmo-msc_10.42.42.6(pid=1174): Launched 11:18:08.012734 run osmo-stp_10.42.42.5(pid=1170): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1170)] 11:18:08.178517 run osmo-stp_10.42.42.5(pid=1170): stdout: | (launched: 2022-12-10_11:18:06.699198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:08.322212 run osmo-stp_10.42.42.5(pid=1170): stderr: | 20221210111806897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111806897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111806897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111806898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111806898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111806898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111806898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:08.461619 run osmo-stp_10.42.42.5(pid=1170): stdout: | (launched: 2022-12-10_11:18:06.699198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:08.593220 run osmo-stp_10.42.42.5(pid=1170): stderr: | 20221210111806897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111806897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111806897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111806898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111806898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111806898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111806898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:08.751501 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1170): Process ended prematurely: osmo-stp_10.42.42.5(pid=1170) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1170)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:18:08.761097 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:18:08.788772 run osmo-hlr_10.42.42.2(pid=1167): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1167)] 11:18:08.839424 run osmo-hlr_10.42.42.2(pid=1167): stdout: | (launched: 2022-12-10_11:18:05.707747) 11:18:08.891372 run osmo-hlr_10.42.42.2(pid=1167): stderr: | 20221210111805887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111805887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111805887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111805887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111805888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111805888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111805901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111805911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111805911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111805911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:08.963709 run osmo-msc_10.42.42.6(pid=1174): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1174)] 11:18:09.014040 run osmo-msc_10.42.42.6(pid=1174): stdout: | (launched: 2022-12-10_11:18:07.752136) 11:18:09.065810 run osmo-msc_10.42.42.6(pid=1174): stderr: | 20221210111808187 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111808187 DLGLOBAL DEBUG validating counter group 0x7fd4b61c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111808187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111808187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111808187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111808187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111808189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111808189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111808190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111808190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:18:09.118293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1166): Terminating (SIGTERM) 11:18:09.160227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1169): Terminating (SIGTERM) 11:18:09.202368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1172): Terminating (SIGTERM) 11:18:09.244544 --- ParallelTerminationStrategy: PID 1166 died... 11:18:09.264697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1166): Terminated: ok {rc=0} 11:18:09.311072 --- ParallelTerminationStrategy: PID 1169 died... 11:18:09.330734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1169): Terminated: ok {rc=0} 11:18:09.376872 --- ParallelTerminationStrategy: PID 1172 died... 11:18:09.396841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1172): Terminated: ok {rc=0} 11:18:09.484758 bus /sierra_3: Setting Powered False 11:18:10.583796 bus /sierra_3: Setting Powered False 11:18:11.700676 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:18:12.850455 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:12.862164 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:18:12.919340 tst mo_mt_call_osmux.py: using LAC 28023 11:18:13.042743 tst mo_mt_call_osmux.py: using RAC 228 11:18:13.167511 tst mo_mt_call_osmux.py: using CellId 28023 11:18:13.289316 tst mo_mt_call_osmux.py: using BVCI 28024 11:18:13.405318 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:13.416433 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:13.427379 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:13.438748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:13.449979 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:18:13.461145 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:18:13.576048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:18:13.695547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:14.211863 run create_hlr_db(pid=1177): Launched 11:18:14.333829 bus /sierra_2: Setting Powered False 11:18:15.394912 run create_hlr_db(pid=1177): Terminated: ok {rc=0} 11:18:15.830662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Launched 11:18:16.202757 run osmo-hlr_10.42.42.2(pid=1180): Launched 11:18:16.460319 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:17.111805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Launched 11:18:17.458190 run osmo-stp_10.42.42.5(pid=1183): Launched 11:18:17.587857 run osmo-msc_10.42.42.6: Starting osmo-msc 11:18:18.188707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Launched 11:18:18.521482 run osmo-msc_10.42.42.6(pid=1186): Launched 11:18:18.708672 run osmo-stp_10.42.42.5(pid=1183): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] 11:18:18.847610 run osmo-stp_10.42.42.5(pid=1183): stdout: | (launched: 2022-12-10_11:18:17.395712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:18.987224 run osmo-stp_10.42.42.5(pid=1183): stderr: | 20221210111817591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111817591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111817592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111817592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111817592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111817592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111817593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:19.125506 run osmo-stp_10.42.42.5(pid=1183): stdout: | (launched: 2022-12-10_11:18:17.395712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:19.257221 run osmo-stp_10.42.42.5(pid=1183): stderr: | 20221210111817591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111817591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111817592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111817592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111817592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111817592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111817593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:19.414717 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1183): Process ended prematurely: osmo-stp_10.42.42.5(pid=1183) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:18:19.424087 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:18:19.452147 run osmo-hlr_10.42.42.2(pid=1180): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1180)] 11:18:19.503200 run osmo-hlr_10.42.42.2(pid=1180): stdout: | (launched: 2022-12-10_11:18:16.138821) 11:18:19.555831 run osmo-hlr_10.42.42.2(pid=1180): stderr: | 20221210111816448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111816448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111816448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111816448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111816448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111816448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111816492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111816500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111816500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111816501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:19.629375 run osmo-msc_10.42.42.6(pid=1186): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1186)] 11:18:19.680381 run osmo-msc_10.42.42.6(pid=1186): stdout: | (launched: 2022-12-10_11:18:18.458604) 11:18:19.733688 run osmo-msc_10.42.42.6(pid=1186): stderr: | 20221210111818786 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111818786 DLGLOBAL DEBUG validating counter group 0x7f24d1093c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111818786 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111818786 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111818786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111818787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111818788 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111818789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111818789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111818789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:18:19.787028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Terminating (SIGTERM) 11:18:19.829841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Terminating (SIGTERM) 11:18:19.872218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Terminating (SIGTERM) 11:18:19.914787 --- ParallelTerminationStrategy: PID 1179 died... 11:18:19.935069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Terminated: ok {rc=0} 11:18:19.981939 --- ParallelTerminationStrategy: PID 1182 died... 11:18:20.001767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Terminated: ok {rc=0} 11:18:20.048367 --- ParallelTerminationStrategy: PID 1185 died... 11:18:20.068094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Terminated: ok {rc=0} 11:18:20.156486 bus /sierra_3: Setting Powered False 11:18:21.257470 bus /sierra_3: Setting Powered False 11:18:22.376046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:18:23.618589 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:18:23.626164 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:18:23.647568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:18:23.674687 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:18:23.726023 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:18:23.747972 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:18:23.775157 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:18:24.331114 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:18:24.382506 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:24.393683 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:18:24.447550 tst mo_mt_call.py: using LAC 28024 11:18:24.566151 tst mo_mt_call.py: using RAC 229 11:18:24.687163 tst mo_mt_call.py: using CellId 28024 11:18:24.809072 tst mo_mt_call.py: using BVCI 28025 11:18:24.922244 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:24.933421 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:24.944108 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:24.955125 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:24.966224 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:24.977530 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:18:25.097192 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:18:25.212673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:25.694056 run create_hlr_db(pid=1191): Launched 11:18:25.811829 bus /sierra_2: Setting Powered False 11:18:26.874102 run create_hlr_db(pid=1191): Terminated: ok {rc=0} 11:18:27.327962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1193): Launched 11:18:27.660732 run osmo-hlr_10.42.42.2(pid=1194): Launched 11:18:27.787938 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:28.360924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1196): Launched 11:18:28.693619 run osmo-stp_10.42.42.5(pid=1197): Launched 11:18:28.819425 run osmo-msc_10.42.42.6: Starting osmo-msc 11:18:29.417459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1199): Launched 11:18:29.750027 run osmo-msc_10.42.42.6(pid=1200): Launched 11:18:29.934414 run osmo-stp_10.42.42.5(pid=1197): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1197)] 11:18:30.072725 run osmo-stp_10.42.42.5(pid=1197): stdout: | (launched: 2022-12-10_11:18:28.631104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:30.212321 run osmo-stp_10.42.42.5(pid=1197): stderr: | 20221210111828827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111828827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111828828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111828828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111828828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111828829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111828829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:30.350278 run osmo-stp_10.42.42.5(pid=1197): stdout: | (launched: 2022-12-10_11:18:28.631104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:30.482145 run osmo-stp_10.42.42.5(pid=1197): stderr: | 20221210111828827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111828827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111828828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111828828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111828828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111828829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111828829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:30.639607 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1197): Process ended prematurely: osmo-stp_10.42.42.5(pid=1197) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1197)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:18:30.649064 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:18:30.676736 run osmo-hlr_10.42.42.2(pid=1194): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1194)] 11:18:30.727834 run osmo-hlr_10.42.42.2(pid=1194): stdout: | (launched: 2022-12-10_11:18:27.598915) 11:18:30.780140 run osmo-hlr_10.42.42.2(pid=1194): stderr: | 20221210111827801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111827801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111827801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111827801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111827801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111827801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111827814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111827824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111827824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111827824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:30.853354 run osmo-msc_10.42.42.6(pid=1200): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1200)] 11:18:30.919308 run osmo-msc_10.42.42.6(pid=1200): stdout: | (launched: 2022-12-10_11:18:29.687237) 11:18:30.972481 run osmo-msc_10.42.42.6(pid=1200): stderr: | 20221210111830015 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111830016 DLGLOBAL DEBUG validating counter group 0x7ff6c2126c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111830016 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111830016 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111830016 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111830016 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111830018 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111830018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111830018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111830019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:18:31.027907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1193): Terminating (SIGTERM) 11:18:31.071195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1196): Terminating (SIGTERM) 11:18:31.116787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1199): Terminating (SIGTERM) 11:18:31.161925 --- ParallelTerminationStrategy: PID 1193 died... 11:18:31.182409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1193): Terminated: ok {rc=0} 11:18:31.232386 --- ParallelTerminationStrategy: PID 1196 died... 11:18:31.252265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1196): Terminated: ok {rc=0} 11:18:31.300432 --- ParallelTerminationStrategy: PID 1199 died... 11:18:31.321637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1199): Terminated: ok {rc=0} 11:18:31.415243 bus /sierra_3: Setting Powered False 11:18:32.529869 bus /sierra_3: Setting Powered False 11:18:33.645875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:18:34.798503 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:34.810693 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:18:34.869432 tst mo_mt_call_osmux.py: using LAC 28025 11:18:35.000688 tst mo_mt_call_osmux.py: using RAC 230 11:18:35.130671 tst mo_mt_call_osmux.py: using CellId 28025 11:18:35.261483 tst mo_mt_call_osmux.py: using BVCI 28026 11:18:35.383891 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:35.395420 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:35.406707 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:35.418455 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:35.430242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:18:35.442056 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:18:35.562179 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:18:35.683010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:36.199933 run create_hlr_db(pid=1202): Launched 11:18:36.334452 bus /sierra_2: Setting Powered False 11:18:37.399539 run create_hlr_db(pid=1202): Terminated: ok {rc=0} 11:18:37.843774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1204): Launched 11:18:38.156503 run osmo-hlr_10.42.42.2(pid=1205): Launched 11:18:38.275385 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:38.826322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1207): Launched 11:18:39.138284 run osmo-stp_10.42.42.5(pid=1208): Launched 11:18:39.257192 run osmo-msc_10.42.42.6: Starting osmo-msc 11:18:39.817314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Launched 11:18:40.129361 run osmo-msc_10.42.42.6(pid=1211): Launched 11:18:40.302150 run osmo-stp_10.42.42.5(pid=1208): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1208)] 11:18:40.440726 run osmo-stp_10.42.42.5(pid=1208): stdout: | (launched: 2022-12-10_11:18:39.079549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:40.581784 run osmo-stp_10.42.42.5(pid=1208): stderr: | 20221210111839251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111839252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111839252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111839252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111839254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111839255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111839255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:40.718900 run osmo-stp_10.42.42.5(pid=1208): stdout: | (launched: 2022-12-10_11:18:39.079549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:40.850360 run osmo-stp_10.42.42.5(pid=1208): stderr: | 20221210111839251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111839252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111839252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111839252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111839254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111839255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111839255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:41.007646 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1208): Process ended prematurely: osmo-stp_10.42.42.5(pid=1208) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1208)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:18:41.017223 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:18:41.045458 run osmo-hlr_10.42.42.2(pid=1205): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1205)] 11:18:41.095899 run osmo-hlr_10.42.42.2(pid=1205): stdout: | (launched: 2022-12-10_11:18:38.097984) 11:18:41.148182 run osmo-hlr_10.42.42.2(pid=1205): stderr: | 20221210111838275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111838275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111838275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111838275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111838275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111838275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111838287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111838297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111838298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111838298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:41.220417 run osmo-msc_10.42.42.6(pid=1211): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1211)] 11:18:41.270510 run osmo-msc_10.42.42.6(pid=1211): stdout: | (launched: 2022-12-10_11:18:40.070429) 11:18:41.322163 run osmo-msc_10.42.42.6(pid=1211): stderr: | 20221210111840343 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111840344 DLGLOBAL DEBUG validating counter group 0x7f36c5b52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111840344 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111840344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111840344 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111840344 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111840346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111840346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111840346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111840347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:18:41.374384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1204): Terminating (SIGTERM) 11:18:41.416092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1207): Terminating (SIGTERM) 11:18:41.458066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Terminating (SIGTERM) 11:18:41.500167 --- ParallelTerminationStrategy: PID 1204 died... 11:18:41.520219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1204): Terminated: ok {rc=0} 11:18:41.567237 --- ParallelTerminationStrategy: PID 1207 died... 11:18:41.587035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1207): Terminated: ok {rc=0} 11:18:41.633568 --- ParallelTerminationStrategy: PID 1210 died... 11:18:41.653221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Terminated: ok {rc=0} 11:18:41.741657 bus /sierra_3: Setting Powered False 11:18:42.840518 bus /sierra_3: Setting Powered False 11:18:43.957808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:18:45.192340 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:18:45.199374 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:18:45.220889 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:18:45.248151 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:18:45.300020 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:18:45.321370 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:18:45.348434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:18:45.912090 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:18:45.972125 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:45.984439 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:18:46.044844 tst mo_mt_call.py: using LAC 28026 11:18:46.174876 tst mo_mt_call.py: using RAC 231 11:18:46.321978 tst mo_mt_call.py: using CellId 28026 11:18:46.445321 tst mo_mt_call.py: using BVCI 28027 11:18:46.569285 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:46.581391 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:46.593686 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:46.606171 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:46.618629 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:46.631033 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:18:46.755263 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:18:46.880389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:47.405676 run create_hlr_db(pid=1216): Launched 11:18:47.539422 bus /sierra_2: Setting Powered False 11:18:48.604137 run create_hlr_db(pid=1216): Terminated: ok {rc=0} 11:18:49.065213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1218): Launched 11:18:49.395708 run osmo-hlr_10.42.42.2(pid=1219): Launched 11:18:49.522308 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:50.091442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1221): Launched 11:18:50.421050 run osmo-stp_10.42.42.5(pid=1222): Launched 11:18:50.545625 run osmo-msc_10.42.42.6: Starting osmo-msc 11:18:51.142818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1224): Launched 11:18:51.473261 run osmo-msc_10.42.42.6(pid=1225): Launched 11:18:51.655919 run osmo-stp_10.42.42.5(pid=1222): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1222)] 11:18:51.794682 run osmo-stp_10.42.42.5(pid=1222): stdout: | (launched: 2022-12-10_11:18:50.359365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:51.934061 run osmo-stp_10.42.42.5(pid=1222): stderr: | 20221210111850555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111850555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111850555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111850556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111850556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111850556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111850556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:52.072643 run osmo-stp_10.42.42.5(pid=1222): stdout: | (launched: 2022-12-10_11:18:50.359365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:52.204649 run osmo-stp_10.42.42.5(pid=1222): stderr: | 20221210111850555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111850555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111850555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111850556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111850556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111850556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111850556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:52.362417 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1222): Process ended prematurely: osmo-stp_10.42.42.5(pid=1222) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1222)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:18:52.371813 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:18:52.399595 run osmo-hlr_10.42.42.2(pid=1219): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1219)] 11:18:52.450251 run osmo-hlr_10.42.42.2(pid=1219): stdout: | (launched: 2022-12-10_11:18:49.333968) 11:18:52.502613 run osmo-hlr_10.42.42.2(pid=1219): stderr: | 20221210111849537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111849537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111849537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111849537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111849537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111849538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111849550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111849559 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111849559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111849559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:52.575441 run osmo-msc_10.42.42.6(pid=1225): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1225)] 11:18:52.626095 run osmo-msc_10.42.42.6(pid=1225): stdout: | (launched: 2022-12-10_11:18:51.411273) 11:18:52.678421 run osmo-msc_10.42.42.6(pid=1225): stderr: | 20221210111851741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111851741 DLGLOBAL DEBUG validating counter group 0x7fec1c724c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111851741 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111851741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111851741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111851742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111851743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111851744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111851744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111851744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:18:52.731136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1218): Terminating (SIGTERM) 11:18:52.773386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1221): Terminating (SIGTERM) 11:18:52.815476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1224): Terminating (SIGTERM) 11:18:52.857717 --- ParallelTerminationStrategy: PID 1218 died... 11:18:52.877796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1218): Terminated: ok {rc=0} 11:18:52.924308 --- ParallelTerminationStrategy: PID 1221 died... 11:18:52.944034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1221): Terminated: ok {rc=0} 11:18:52.990236 --- ParallelTerminationStrategy: PID 1224 died... 11:18:53.009915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1224): Terminated: ok {rc=0} 11:18:53.097507 bus /sierra_3: Setting Powered False 11:18:54.197158 bus /sierra_3: Setting Powered False 11:18:55.315079 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:18:56.462139 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:56.474084 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:18:56.530470 tst mo_mt_call_osmux.py: using LAC 28027 11:18:56.651638 tst mo_mt_call_osmux.py: using RAC 232 11:18:56.774221 tst mo_mt_call_osmux.py: using CellId 28027 11:18:56.896661 tst mo_mt_call_osmux.py: using BVCI 28028 11:18:57.008458 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:57.019681 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:57.030602 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:57.041880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:57.052935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:18:57.064140 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:18:57.182666 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:18:57.301215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:57.782505 run create_hlr_db(pid=1227): Launched 11:18:57.899421 bus /sierra_2: Setting Powered False 11:18:58.960852 run create_hlr_db(pid=1227): Terminated: ok {rc=0} 11:18:59.393630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1229): Launched 11:18:59.703817 run osmo-hlr_10.42.42.2(pid=1230): Launched 11:18:59.821378 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:00.357685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1233): Launched 11:19:00.668258 run osmo-stp_10.42.42.5(pid=1234): Launched 11:19:00.785518 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:01.438926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1236): Launched 11:19:01.795217 run osmo-msc_10.42.42.6(pid=1237): Launched 11:19:02.123311 run osmo-stp_10.42.42.5(pid=1234): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1234)] 11:19:02.284818 run osmo-stp_10.42.42.5(pid=1234): stdout: | (launched: 2022-12-10_11:19:00.609400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:02.425609 run osmo-stp_10.42.42.5(pid=1234): stderr: | 20221210111900784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111900784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111900785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111900785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111900786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111900786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111900786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:02.563237 run osmo-stp_10.42.42.5(pid=1234): stdout: | (launched: 2022-12-10_11:19:00.609400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:02.695593 run osmo-stp_10.42.42.5(pid=1234): stderr: | 20221210111900784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111900784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111900785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111900785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111900786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111900786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111900786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:02.854102 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1234): Process ended prematurely: osmo-stp_10.42.42.5(pid=1234) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1234)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:19:02.863868 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:19:02.891607 run osmo-hlr_10.42.42.2(pid=1230): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1230)] 11:19:02.942854 run osmo-hlr_10.42.42.2(pid=1230): stdout: | (launched: 2022-12-10_11:18:59.645493) 11:19:02.994869 run osmo-hlr_10.42.42.2(pid=1230): stderr: | 20221210111859823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111859823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111859824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111859824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111859824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111859824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111859838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111859848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111859848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111859848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:03.067772 run osmo-msc_10.42.42.6(pid=1237): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1237)] 11:19:03.118115 run osmo-msc_10.42.42.6(pid=1237): stdout: | (launched: 2022-12-10_11:19:01.730245) 11:19:03.170091 run osmo-msc_10.42.42.6(pid=1237): stderr: | 20221210111902229 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111902229 DLGLOBAL DEBUG validating counter group 0x7f01139bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111902229 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111902229 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111902229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111902229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111902231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111902232 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111902232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111902232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:03.222567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1229): Terminating (SIGTERM) 11:19:03.264560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1233): Terminating (SIGTERM) 11:19:03.306847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1236): Terminating (SIGTERM) 11:19:03.349223 --- ParallelTerminationStrategy: PID 1229 died... 11:19:03.369386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1229): Terminated: ok {rc=0} 11:19:03.415827 --- ParallelTerminationStrategy: PID 1233 died... 11:19:03.435432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1233): Terminated: ok {rc=0} 11:19:03.481400 --- ParallelTerminationStrategy: PID 1236 died... 11:19:03.501083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1236): Terminated: ok {rc=0} 11:19:03.589138 bus /sierra_3: Setting Powered False 11:19:04.687386 bus /sierra_3: Setting Powered False 11:19:05.800799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:19:07.042793 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:07.049629 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:19:07.071335 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:19:07.100111 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:19:07.154160 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:19:07.175248 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:19:07.203086 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:19:07.753863 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:19:07.807345 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:07.818746 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:19:07.879906 tst mo_mt_call.py: using LAC 28028 11:19:08.002167 tst mo_mt_call.py: using RAC 233 11:19:08.124116 tst mo_mt_call.py: using CellId 28028 11:19:08.244258 tst mo_mt_call.py: using BVCI 28029 11:19:08.356551 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:08.367836 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:08.378836 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:08.390145 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:08.401241 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:08.412270 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:19:08.533894 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:19:08.657150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:09.174618 run create_hlr_db(pid=1243): Launched 11:19:09.308238 bus /sierra_2: Setting Powered False 11:19:10.369076 run create_hlr_db(pid=1243): Terminated: ok {rc=0} 11:19:10.813648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1245): Launched 11:19:11.125977 run osmo-hlr_10.42.42.2(pid=1246): Launched 11:19:11.243178 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:11.792019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1248): Launched 11:19:12.130832 run osmo-stp_10.42.42.5(pid=1249): Launched 11:19:12.248939 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:12.809993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1251): Launched 11:19:13.121608 run osmo-msc_10.42.42.6(pid=1252): Launched 11:19:13.294821 run osmo-stp_10.42.42.5(pid=1249): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1249)] 11:19:13.427102 run osmo-stp_10.42.42.5(pid=1249): stdout: | (launched: 2022-12-10_11:19:12.072086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:13.558204 run osmo-stp_10.42.42.5(pid=1249): stderr: | 20221210111912244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111912245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111912245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111912245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111912246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111912246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111912246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:13.686752 run osmo-stp_10.42.42.5(pid=1249): stdout: | (launched: 2022-12-10_11:19:12.072086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:13.810525 run osmo-stp_10.42.42.5(pid=1249): stderr: | 20221210111912244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111912245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111912245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111912245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111912246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111912246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111912246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:13.958265 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1249): Process ended prematurely: osmo-stp_10.42.42.5(pid=1249) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1249)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:19:13.967182 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:19:13.994118 run osmo-hlr_10.42.42.2(pid=1246): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1246)] 11:19:14.043155 run osmo-hlr_10.42.42.2(pid=1246): stdout: | (launched: 2022-12-10_11:19:11.066625) 11:19:14.093534 run osmo-hlr_10.42.42.2(pid=1246): stderr: | 20221210111911245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111911245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111911245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111911245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111911246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111911246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111911258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111911267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111911267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111911267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:14.163207 run osmo-msc_10.42.42.6(pid=1252): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1252)] 11:19:14.211584 run osmo-msc_10.42.42.6(pid=1252): stdout: | (launched: 2022-12-10_11:19:13.062891) 11:19:14.262103 run osmo-msc_10.42.42.6(pid=1252): stderr: | 20221210111913339 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111913339 DLGLOBAL DEBUG validating counter group 0x7f3c7747ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111913340 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111913340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111913340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111913340 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111913344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111913344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111913344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111913344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:14.312587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1245): Terminating (SIGTERM) 11:19:14.352813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1248): Terminating (SIGTERM) 11:19:14.392906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1251): Terminating (SIGTERM) 11:19:14.433500 --- ParallelTerminationStrategy: PID 1245 died... 11:19:14.452519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1245): Terminated: ok {rc=0} 11:19:14.497903 --- ParallelTerminationStrategy: PID 1248 died... 11:19:14.516589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1248): Terminated: ok {rc=0} 11:19:14.562009 --- ParallelTerminationStrategy: PID 1251 died... 11:19:14.580700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1251): Terminated: ok {rc=0} 11:19:14.667748 bus /sierra_3: Setting Powered False 11:19:15.768663 bus /sierra_3: Setting Powered False 11:19:16.890827 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:19:18.054481 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:18.066585 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:19:18.124283 tst mo_mt_call_osmux.py: using LAC 28029 11:19:18.254411 tst mo_mt_call_osmux.py: using RAC 234 11:19:18.375647 tst mo_mt_call_osmux.py: using CellId 28029 11:19:18.498662 tst mo_mt_call_osmux.py: using BVCI 28030 11:19:18.610851 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:18.622112 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:18.633176 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:18.644638 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:18.656041 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:19:18.667499 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:19:18.787679 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:19:18.907751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:19.425245 run create_hlr_db(pid=1254): Launched 11:19:19.560248 bus /sierra_2: Setting Powered False 11:19:20.625681 run create_hlr_db(pid=1254): Terminated: ok {rc=0} 11:19:21.070540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1257): Launched 11:19:21.383236 run osmo-hlr_10.42.42.2(pid=1258): Launched 11:19:21.501522 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:22.040862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1260): Launched 11:19:22.353501 run osmo-stp_10.42.42.5(pid=1261): Launched 11:19:22.471616 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:23.032530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1263): Launched 11:19:23.344024 run osmo-msc_10.42.42.6(pid=1264): Launched 11:19:23.517317 run osmo-stp_10.42.42.5(pid=1261): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1261)] 11:19:23.648718 run osmo-stp_10.42.42.5(pid=1261): stdout: | (launched: 2022-12-10_11:19:22.294396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:23.779430 run osmo-stp_10.42.42.5(pid=1261): stderr: | 20221210111922466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111922466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111922466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111922467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111922469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111922469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111922469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:23.907966 run osmo-stp_10.42.42.5(pid=1261): stdout: | (launched: 2022-12-10_11:19:22.294396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:24.031865 run osmo-stp_10.42.42.5(pid=1261): stderr: | 20221210111922466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111922466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111922466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111922467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111922469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111922469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111922469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:24.179707 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1261): Process ended prematurely: osmo-stp_10.42.42.5(pid=1261) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1261)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:19:24.188840 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:19:24.216021 run osmo-hlr_10.42.42.2(pid=1258): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1258)] 11:19:24.264315 run osmo-hlr_10.42.42.2(pid=1258): stdout: | (launched: 2022-12-10_11:19:21.323992) 11:19:24.314498 run osmo-hlr_10.42.42.2(pid=1258): stderr: | 20221210111921506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111921506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111921506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111921506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111921506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111921506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111921519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111921530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111921530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111921530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:24.384044 run osmo-msc_10.42.42.6(pid=1264): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1264)] 11:19:24.432379 run osmo-msc_10.42.42.6(pid=1264): stdout: | (launched: 2022-12-10_11:19:23.285453) 11:19:24.482681 run osmo-msc_10.42.42.6(pid=1264): stderr: | 20221210111923560 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111923560 DLGLOBAL DEBUG validating counter group 0x7fad28d94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111923560 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111923560 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111923561 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111923561 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111923563 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111923563 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111923563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111923563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:24.533019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1257): Terminating (SIGTERM) 11:19:24.573118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1260): Terminating (SIGTERM) 11:19:24.613676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1263): Terminating (SIGTERM) 11:19:24.654200 --- ParallelTerminationStrategy: PID 1257 died... 11:19:24.673253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1257): Terminated: ok {rc=0} 11:19:24.718003 --- ParallelTerminationStrategy: PID 1260 died... 11:19:24.736653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1260): Terminated: ok {rc=0} 11:19:24.781370 --- ParallelTerminationStrategy: PID 1263 died... 11:19:24.800154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1263): Terminated: ok {rc=0} 11:19:24.885217 bus /sierra_3: Setting Powered False 11:19:25.983267 bus /sierra_3: Setting Powered False 11:19:27.100361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:19:28.337781 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:28.344841 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:19:28.366560 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:19:28.393703 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:19:28.447553 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:19:28.469114 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:19:28.496152 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:19:29.046144 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:19:29.098826 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:29.110286 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:19:29.167595 tst mo_mt_call.py: using LAC 28030 11:19:29.298870 tst mo_mt_call.py: using RAC 235 11:19:29.431046 tst mo_mt_call.py: using CellId 28030 11:19:29.563089 tst mo_mt_call.py: using BVCI 28031 11:19:29.683369 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:29.695027 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:29.706389 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:29.717726 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:29.728996 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:29.740393 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:19:29.856399 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:19:29.977134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:30.492885 run create_hlr_db(pid=1269): Launched 11:19:30.626550 bus /sierra_2: Setting Powered False 11:19:31.702167 run create_hlr_db(pid=1269): Terminated: ok {rc=0} 11:19:32.202000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1271): Launched 11:19:32.543574 run osmo-hlr_10.42.42.2(pid=1272): Launched 11:19:32.671962 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:33.242178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1274): Launched 11:19:33.576162 run osmo-stp_10.42.42.5(pid=1275): Launched 11:19:33.701135 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:34.299170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1277): Launched 11:19:34.631346 run osmo-msc_10.42.42.6(pid=1278): Launched 11:19:34.814534 run osmo-stp_10.42.42.5(pid=1275): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1275)] 11:19:34.952775 run osmo-stp_10.42.42.5(pid=1275): stdout: | (launched: 2022-12-10_11:19:33.514215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:35.091686 run osmo-stp_10.42.42.5(pid=1275): stderr: | 20221210111933709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111933709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111933709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111933710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111933710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111933710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111933710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:35.230122 run osmo-stp_10.42.42.5(pid=1275): stdout: | (launched: 2022-12-10_11:19:33.514215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:35.361996 run osmo-stp_10.42.42.5(pid=1275): stderr: | 20221210111933709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111933709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111933709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111933710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111933710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111933710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111933710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:35.520214 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1275): Process ended prematurely: osmo-stp_10.42.42.5(pid=1275) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1275)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:19:35.530179 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:19:35.558233 run osmo-hlr_10.42.42.2(pid=1272): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1272)] 11:19:35.608508 run osmo-hlr_10.42.42.2(pid=1272): stdout: | (launched: 2022-12-10_11:19:32.481674) 11:19:35.660462 run osmo-hlr_10.42.42.2(pid=1272): stderr: | 20221210111932684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111932684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111932684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111932684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111932684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111932684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111932697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111932705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111932706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111932706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:35.732341 run osmo-msc_10.42.42.6(pid=1278): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1278)] 11:19:35.783341 run osmo-msc_10.42.42.6(pid=1278): stdout: | (launched: 2022-12-10_11:19:34.569243) 11:19:35.835197 run osmo-msc_10.42.42.6(pid=1278): stderr: | 20221210111934897 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111934897 DLGLOBAL DEBUG validating counter group 0x7f2c9cea0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111934897 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111934897 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111934898 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111934898 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111934899 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111934900 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111934900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111934900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:35.887442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1271): Terminating (SIGTERM) 11:19:35.929580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1274): Terminating (SIGTERM) 11:19:35.971753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1277): Terminating (SIGTERM) 11:19:36.014020 --- ParallelTerminationStrategy: PID 1271 died... 11:19:36.033783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1271): Terminated: ok {rc=0} 11:19:36.080587 --- ParallelTerminationStrategy: PID 1274 died... 11:19:36.100337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1274): Terminated: ok {rc=0} 11:19:36.146907 --- ParallelTerminationStrategy: PID 1277 died... 11:19:36.166739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1277): Terminated: ok {rc=0} 11:19:36.255379 bus /sierra_3: Setting Powered False 11:19:37.354141 bus /sierra_3: Setting Powered False 11:19:38.470282 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:19:39.618728 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:39.630682 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:19:39.686776 tst mo_mt_call_osmux.py: using LAC 28031 11:19:39.808859 tst mo_mt_call_osmux.py: using RAC 236 11:19:39.929095 tst mo_mt_call_osmux.py: using CellId 28031 11:19:40.061023 tst mo_mt_call_osmux.py: using BVCI 28032 11:19:40.182203 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:40.193978 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:40.206055 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:40.217908 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:40.229406 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:19:40.240795 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:19:40.356427 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:19:40.479209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:40.993212 run create_hlr_db(pid=1280): Launched 11:19:41.126340 bus /sierra_2: Setting Powered False 11:19:42.192236 run create_hlr_db(pid=1280): Terminated: ok {rc=0} 11:19:42.635023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1282): Launched 11:19:42.947056 run osmo-hlr_10.42.42.2(pid=1283): Launched 11:19:43.064284 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:43.611933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1285): Launched 11:19:43.923586 run osmo-stp_10.42.42.5(pid=1286): Launched 11:19:44.041856 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:44.604020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1288): Launched 11:19:44.915735 run osmo-msc_10.42.42.6(pid=1289): Launched 11:19:45.089320 run osmo-stp_10.42.42.5(pid=1286): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1286)] 11:19:45.220772 run osmo-stp_10.42.42.5(pid=1286): stdout: | (launched: 2022-12-10_11:19:43.864654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:45.351944 run osmo-stp_10.42.42.5(pid=1286): stderr: | 20221210111944039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111944039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111944040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111944040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111944041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111944041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111944041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:45.480940 run osmo-stp_10.42.42.5(pid=1286): stdout: | (launched: 2022-12-10_11:19:43.864654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:45.604543 run osmo-stp_10.42.42.5(pid=1286): stderr: | 20221210111944039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111944039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111944040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111944040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111944041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111944041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111944041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:45.752418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1286): Process ended prematurely: osmo-stp_10.42.42.5(pid=1286) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1286)] [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:19:45.761498 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:19:45.788121 run osmo-hlr_10.42.42.2(pid=1283): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1283)] 11:19:45.843650 run osmo-hlr_10.42.42.2(pid=1283): stdout: | (launched: 2022-12-10_11:19:42.888387) 11:19:45.898009 run osmo-hlr_10.42.42.2(pid=1283): stderr: | 20221210111943069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111943069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111943069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111943069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111943069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111943069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111943081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111943090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111943090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111943090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:45.974524 run osmo-msc_10.42.42.6(pid=1289): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1289)] 11:19:46.027743 run osmo-msc_10.42.42.6(pid=1289): stdout: | (launched: 2022-12-10_11:19:44.857312) 11:19:46.083660 run osmo-msc_10.42.42.6(pid=1289): stderr: | 20221210111945135 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111945135 DLGLOBAL DEBUG validating counter group 0x7fa1ce2bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111945135 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111945135 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111945135 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111945135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111945137 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111945138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111945138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111945138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:46.139296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1282): Terminating (SIGTERM) 11:19:46.184154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1285): Terminating (SIGTERM) 11:19:46.229932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1288): Terminating (SIGTERM) 11:19:46.276626 --- ParallelTerminationStrategy: PID 1282 died... 11:19:46.297983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1282): Terminated: ok {rc=0} 11:19:46.349730 --- ParallelTerminationStrategy: PID 1285 died... 11:19:46.370173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1285): Terminated: ok {rc=0} 11:19:46.419578 --- ParallelTerminationStrategy: PID 1288 died... 11:19:46.440076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1288): Terminated: ok {rc=0} 11:19:46.536487 bus /sierra_3: Setting Powered False 11:19:47.637910 bus /sierra_3: Setting Powered False 11:19:48.754137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:19:49.993920 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:50.001044 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:19:50.022781 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:19:50.050507 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:19:50.103579 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:19:50.124933 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:19:50.152437 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:19:50.699798 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:19:50.750502 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:19:50.761886 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:19:50.817900 tst mo_mt_call.py: using LAC 28032 11:19:50.941290 tst mo_mt_call.py: using RAC 237 11:19:51.062302 tst mo_mt_call.py: using CellId 28032 11:19:51.185586 tst mo_mt_call.py: using BVCI 28033 11:19:51.306110 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:19:51.317783 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:19:51.329256 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:19:51.340469 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:19:51.351864 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:19:51.363650 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:19:51.483844 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:19:51.600218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:52.083526 run create_hlr_db(pid=1294): Launched 11:19:52.202253 bus /sierra_2: Setting Powered False 11:19:53.263537 run create_hlr_db(pid=1294): Terminated: ok {rc=0} 11:19:53.718889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1296): Launched 11:19:54.053461 run osmo-hlr_10.42.42.2(pid=1297): Launched 11:19:54.179199 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:54.748493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1299): Launched 11:19:55.080541 run osmo-stp_10.42.42.5(pid=1300): Launched 11:19:55.205965 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:55.804603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1302): Launched 11:19:56.137226 run osmo-msc_10.42.42.6(pid=1303): Launched 11:19:56.320429 run osmo-stp_10.42.42.5(pid=1300): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1300)] 11:19:56.462780 run osmo-stp_10.42.42.5(pid=1300): stdout: | (launched: 2022-12-10_11:19:55.018475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:56.603291 run osmo-stp_10.42.42.5(pid=1300): stderr: | 20221210111955213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111955214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111955214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111955214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111955215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111955215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111955215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:56.740820 run osmo-stp_10.42.42.5(pid=1300): stdout: | (launched: 2022-12-10_11:19:55.018475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:56.873618 run osmo-stp_10.42.42.5(pid=1300): stderr: | 20221210111955213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111955214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111955214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111955214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111955215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111955215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111955215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:57.031510 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1300): Process ended prematurely: osmo-stp_10.42.42.5(pid=1300) [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1300)] [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:19:57.041227 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:19:57.069333 run osmo-hlr_10.42.42.2(pid=1297): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1297)] 11:19:57.120029 run osmo-hlr_10.42.42.2(pid=1297): stdout: | (launched: 2022-12-10_11:19:53.991306) 11:19:57.172320 run osmo-hlr_10.42.42.2(pid=1297): stderr: | 20221210111954196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111954196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111954196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111954196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111954196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111954196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111954208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111954216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111954216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111954216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:57.244896 run osmo-msc_10.42.42.6(pid=1303): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1303)] 11:19:57.295348 run osmo-msc_10.42.42.6(pid=1303): stdout: | (launched: 2022-12-10_11:19:56.075072) 11:19:57.347516 run osmo-msc_10.42.42.6(pid=1303): stderr: | 20221210111956401 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111956401 DLGLOBAL DEBUG validating counter group 0x7fc493194c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111956401 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111956401 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111956402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111956402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111956403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111956404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111956404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111956404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:57.400087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1296): Terminating (SIGTERM) 11:19:57.442105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1299): Terminating (SIGTERM) 11:19:57.484078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1302): Terminating (SIGTERM) 11:19:57.526546 --- ParallelTerminationStrategy: PID 1296 died... 11:19:57.546581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1296): Terminated: ok {rc=0} 11:19:57.593321 --- ParallelTerminationStrategy: PID 1299 died... 11:19:57.612998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1299): Terminated: ok {rc=0} 11:19:57.659652 --- ParallelTerminationStrategy: PID 1302 died... 11:19:57.679415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1302): Terminated: ok {rc=0} 11:19:57.768746 bus /sierra_3: Setting Powered False 11:19:58.869763 bus /sierra_3: Setting Powered False 11:19:59.987149 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:20:01.161881 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:20:01.177844 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:20:01.245745 tst mo_mt_call_osmux.py: using LAC 28033 11:20:01.373789 tst mo_mt_call_osmux.py: using RAC 238 11:20:01.501388 tst mo_mt_call_osmux.py: using CellId 28033 11:20:01.671789 tst mo_mt_call_osmux.py: using BVCI 28034 11:20:01.842590 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:20:01.859073 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:20:01.874946 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:20:01.890940 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:20:01.903850 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:20:01.918321 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:20:02.039476 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:20:02.182059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:02.672690 run create_hlr_db(pid=1308): Launched 11:20:02.791299 bus /sierra_2: Setting Powered False 11:20:03.852904 run create_hlr_db(pid=1308): Terminated: ok {rc=0} 11:20:04.287640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1310): Launched 11:20:04.601353 run osmo-hlr_10.42.42.2(pid=1311): Launched 11:20:04.719423 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:05.268283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1313): Launched 11:20:05.581128 run osmo-stp_10.42.42.5(pid=1314): Launched 11:20:05.699983 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:06.276478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1316): Launched 11:20:06.587683 run osmo-msc_10.42.42.6(pid=1317): Launched 11:20:06.759984 run osmo-stp_10.42.42.5(pid=1314): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1314)] 11:20:06.890502 run osmo-stp_10.42.42.5(pid=1314): stdout: | (launched: 2022-12-10_11:20:05.522473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:07.021801 run osmo-stp_10.42.42.5(pid=1314): stderr: | 20221210112005696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112005697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112005697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112005697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112005698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112005698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112005698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:07.150987 run osmo-stp_10.42.42.5(pid=1314): stdout: | (launched: 2022-12-10_11:20:05.522473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:07.274279 run osmo-stp_10.42.42.5(pid=1314): stderr: | 20221210112005696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112005697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112005697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112005697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112005698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112005698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112005698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:07.422116 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1314): Process ended prematurely: osmo-stp_10.42.42.5(pid=1314) [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1314)] [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:20:07.430861 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:20:07.457461 run osmo-hlr_10.42.42.2(pid=1311): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1311)] 11:20:07.505216 run osmo-hlr_10.42.42.2(pid=1311): stdout: | (launched: 2022-12-10_11:20:04.542069) 11:20:07.554836 run osmo-hlr_10.42.42.2(pid=1311): stderr: | 20221210112004724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112004724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112004724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112004724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112004724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112004724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112004736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112004746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112004746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112004747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:07.623650 run osmo-msc_10.42.42.6(pid=1317): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1317)] 11:20:07.671911 run osmo-msc_10.42.42.6(pid=1317): stdout: | (launched: 2022-12-10_11:20:06.528592) 11:20:07.721288 run osmo-msc_10.42.42.6(pid=1317): stderr: | 20221210112006805 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112006805 DLGLOBAL DEBUG validating counter group 0x7f7624bb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112006805 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112006805 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112006805 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112006806 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112006807 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112006808 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112006808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112006808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:07.770939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1310): Terminating (SIGTERM) 11:20:07.810449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1313): Terminating (SIGTERM) 11:20:07.850117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1316): Terminating (SIGTERM) 11:20:07.889930 --- ParallelTerminationStrategy: PID 1310 died... 11:20:07.908818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1310): Terminated: ok {rc=0} 11:20:07.952801 --- ParallelTerminationStrategy: PID 1313 died... 11:20:07.971678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1313): Terminated: ok {rc=0} 11:20:08.016144 --- ParallelTerminationStrategy: PID 1316 died... 11:20:08.034658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1316): Terminated: ok {rc=0} 11:20:08.122201 bus /sierra_3: Setting Powered False 11:20:09.222330 bus /sierra_3: Setting Powered False 11:20:10.337694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:20:11.573755 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:11.579484 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:20:11.600331 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:20:11.628134 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:20:11.680312 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:20:11.700868 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:20:11.727385 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:20:12.279083 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:20:12.334546 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:12.346127 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:20:12.402992 tst mo_mt_call.py: using LAC 28034 11:20:12.530861 tst mo_mt_call.py: using RAC 239 11:20:12.658452 tst mo_mt_call.py: using CellId 28034 11:20:12.786688 tst mo_mt_call.py: using BVCI 28035 11:20:12.906979 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:12.918389 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:12.929587 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:12.940891 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:12.952201 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:12.963504 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:20:13.079723 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:20:13.198974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:13.680614 run create_hlr_db(pid=1322): Launched 11:20:13.799811 bus /sierra_2: Setting Powered False 11:20:14.861739 run create_hlr_db(pid=1322): Terminated: ok {rc=0} 11:20:15.316831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1324): Launched 11:20:15.650380 run osmo-hlr_10.42.42.2(pid=1325): Launched 11:20:15.776899 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:16.441410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1327): Launched 11:20:16.790265 run osmo-stp_10.42.42.5(pid=1328): Launched 11:20:17.100179 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:17.725393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1330): Launched 11:20:18.058313 run osmo-msc_10.42.42.6(pid=1331): Launched 11:20:18.242901 run osmo-stp_10.42.42.5(pid=1328): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1328)] 11:20:18.382599 run osmo-stp_10.42.42.5(pid=1328): stdout: | (launched: 2022-12-10_11:20:16.726471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:18.522437 run osmo-stp_10.42.42.5(pid=1328): stderr: | 20221210112016956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112016956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112016956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112016956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112016958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112016958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112016958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:18.661366 run osmo-stp_10.42.42.5(pid=1328): stdout: | (launched: 2022-12-10_11:20:16.726471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:18.794882 run osmo-stp_10.42.42.5(pid=1328): stderr: | 20221210112016956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112016956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112016956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112016956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112016958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112016958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112016958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:18.953780 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1328): Process ended prematurely: osmo-stp_10.42.42.5(pid=1328) [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1328)] [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:20:18.963440 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:20:18.991454 run osmo-hlr_10.42.42.2(pid=1325): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1325)] 11:20:19.042088 run osmo-hlr_10.42.42.2(pid=1325): stdout: | (launched: 2022-12-10_11:20:15.588328) 11:20:19.094727 run osmo-hlr_10.42.42.2(pid=1325): stderr: | 20221210112015793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112015793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112015793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112015793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112015793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112015793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112015806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112015814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112015814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112015815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:19.167914 run osmo-msc_10.42.42.6(pid=1331): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1331)] 11:20:19.218935 run osmo-msc_10.42.42.6(pid=1331): stdout: | (launched: 2022-12-10_11:20:17.996253) 11:20:19.271258 run osmo-msc_10.42.42.6(pid=1331): stderr: | 20221210112018322 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112018322 DLGLOBAL DEBUG validating counter group 0x7f0b3d9f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112018322 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112018322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112018322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112018323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112018325 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112018326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112018326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112018326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:19.323671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1324): Terminating (SIGTERM) 11:20:19.366062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1327): Terminating (SIGTERM) 11:20:19.408560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1330): Terminating (SIGTERM) 11:20:19.451231 --- ParallelTerminationStrategy: PID 1324 died... 11:20:19.471523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1324): Terminated: ok {rc=0} 11:20:19.518605 --- ParallelTerminationStrategy: PID 1327 died... 11:20:19.538451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1327): Terminated: ok {rc=0} 11:20:19.585538 --- ParallelTerminationStrategy: PID 1330 died... 11:20:19.605479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1330): Terminated: ok {rc=0} 11:20:19.694261 bus /sierra_3: Setting Powered False 11:20:20.793756 bus /sierra_3: Setting Powered False 11:20:21.909297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:20:23.054551 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:23.066357 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:20:23.126025 tst mo_mt_call_osmux.py: using LAC 28035 11:20:23.255583 tst mo_mt_call_osmux.py: using RAC 240 11:20:23.383544 tst mo_mt_call_osmux.py: using CellId 28035 11:20:23.516229 tst mo_mt_call_osmux.py: using BVCI 28036 11:20:23.638384 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:23.650122 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:23.661500 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:23.672835 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:23.684209 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:20:23.695683 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:20:23.812246 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:20:23.932710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:24.447844 run create_hlr_db(pid=1333): Launched 11:20:24.582609 bus /sierra_2: Setting Powered False 11:20:25.643278 run create_hlr_db(pid=1333): Terminated: ok {rc=0} 11:20:26.108727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1335): Launched 11:20:26.441622 run osmo-hlr_10.42.42.2(pid=1336): Launched 11:20:26.567171 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:27.141675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1338): Launched 11:20:27.474516 run osmo-stp_10.42.42.5(pid=1339): Launched 11:20:27.600160 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:28.199913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1341): Launched 11:20:28.533232 run osmo-msc_10.42.42.6(pid=1342): Launched 11:20:28.716319 run osmo-stp_10.42.42.5(pid=1339): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1339)] 11:20:28.855952 run osmo-stp_10.42.42.5(pid=1339): stdout: | (launched: 2022-12-10_11:20:27.412110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:28.995393 run osmo-stp_10.42.42.5(pid=1339): stderr: | 20221210112027608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112027608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112027609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112027609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112027609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112027610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112027610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:29.133873 run osmo-stp_10.42.42.5(pid=1339): stdout: | (launched: 2022-12-10_11:20:27.412110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:29.265995 run osmo-stp_10.42.42.5(pid=1339): stderr: | 20221210112027608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112027608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112027609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112027609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112027609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112027610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112027610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:29.423646 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1339): Process ended prematurely: osmo-stp_10.42.42.5(pid=1339) [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1339)] [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:20:29.433107 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:20:29.460691 run osmo-hlr_10.42.42.2(pid=1336): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1336)] 11:20:29.511014 run osmo-hlr_10.42.42.2(pid=1336): stdout: | (launched: 2022-12-10_11:20:26.379675) 11:20:29.562911 run osmo-hlr_10.42.42.2(pid=1336): stderr: | 20221210112026584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112026584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112026584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112026584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112026585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112026585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112026597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112026607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112026607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112026607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:29.635102 run osmo-msc_10.42.42.6(pid=1342): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1342)] 11:20:29.686054 run osmo-msc_10.42.42.6(pid=1342): stdout: | (launched: 2022-12-10_11:20:28.470258) 11:20:29.737786 run osmo-msc_10.42.42.6(pid=1342): stderr: | 20221210112028798 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112028798 DLGLOBAL DEBUG validating counter group 0x7ff92d366c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112028799 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112028799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112028799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112028799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112028801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112028801 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112028801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112028801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:29.790289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1335): Terminating (SIGTERM) 11:20:29.832314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1338): Terminating (SIGTERM) 11:20:29.874313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1341): Terminating (SIGTERM) 11:20:29.916633 --- ParallelTerminationStrategy: PID 1335 died... 11:20:29.936351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1335): Terminated: ok {rc=0} 11:20:29.982741 --- ParallelTerminationStrategy: PID 1338 died... 11:20:30.002189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1338): Terminated: ok {rc=0} 11:20:30.048269 --- ParallelTerminationStrategy: PID 1341 died... 11:20:30.067773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1341): Terminated: ok {rc=0} 11:20:30.156383 bus /sierra_3: Setting Powered False 11:20:31.255811 bus /sierra_3: Setting Powered False 11:20:32.377019 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:sysmo --------------------------------------------------------------------- 11:20:33.612077 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:33.616352 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 11:20:33.637732 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 11:20:33.664879 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 11:20:33.749125 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 11:20:33.769678 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 11:20:33.796580 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 11:20:34.377768 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 11:20:34.382996 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:34.393895 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:20:34.430461 tst emergency_mo_mt_call.py: using LAC 28036 11:20:34.552315 tst emergency_mo_mt_call.py: using RAC 241 11:20:34.672909 tst emergency_mo_mt_call.py: using CellId 28036 11:20:34.791703 tst emergency_mo_mt_call.py: using BVCI 28037 11:20:34.903145 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:34.913850 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:34.924348 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:34.935291 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:34.946201 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:34.957141 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:20:35.076116 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:20:35.193669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:35.668929 run create_hlr_db(pid=1347): Launched 11:20:35.784750 bus /sierra_2: Setting Powered False 11:20:36.845488 run create_hlr_db(pid=1347): Terminated: ok {rc=0} 11:20:37.272874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1349): Launched 11:20:37.579973 run osmo-hlr_10.42.42.2(pid=1350): Launched 11:20:37.696861 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:38.222129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1352): Launched 11:20:38.528649 run osmo-stp_10.42.42.5(pid=1353): Launched 11:20:38.655516 tst emergency_mo_mt_call.py: using MSISDN 7712 11:20:38.811808 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:39.359986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1355): Launched 11:20:39.666896 run osmo-msc_10.42.42.6(pid=1356): Launched 11:20:39.837081 run osmo-stp_10.42.42.5(pid=1353): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1353)] 11:20:39.965700 run osmo-stp_10.42.42.5(pid=1353): stdout: | (launched: 2022-12-10_11:20:38.470411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:40.094147 run osmo-stp_10.42.42.5(pid=1353): stderr: | 20221210112038641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112038641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112038641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112038642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112038644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112038644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112038644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:40.220646 run osmo-stp_10.42.42.5(pid=1353): stdout: | (launched: 2022-12-10_11:20:38.470411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:40.342094 run osmo-stp_10.42.42.5(pid=1353): stderr: | 20221210112038641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112038641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112038641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112038642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112038644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112038644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112038644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:40.487026 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1353): Process ended prematurely: osmo-stp_10.42.42.5(pid=1353) [trial-2374↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1353)] [trial-2374↪emergency:sysmo↪emergency_mo_mt_call.py:19] 11:20:40.495422 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 11:20:40.521680 run osmo-hlr_10.42.42.2(pid=1350): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1350)] 11:20:40.569802 run osmo-hlr_10.42.42.2(pid=1350): stdout: | (launched: 2022-12-10_11:20:37.522006) 11:20:40.619389 run osmo-hlr_10.42.42.2(pid=1350): stderr: | 20221210112037698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112037698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112037698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112037698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112037698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112037698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112037711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112037721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112037721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112037721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:40.688110 run osmo-msc_10.42.42.6(pid=1356): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1356)] 11:20:40.736244 run osmo-msc_10.42.42.6(pid=1356): stdout: | (launched: 2022-12-10_11:20:39.608231) 11:20:40.785909 run osmo-msc_10.42.42.6(pid=1356): stderr: | 20221210112039882 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112039882 DLGLOBAL DEBUG validating counter group 0x7f7b4d5a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112039882 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112039882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112039882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112039883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112039884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112039885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112039885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112039885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:40.836099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1349): Terminating (SIGTERM) 11:20:40.876259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1352): Terminating (SIGTERM) 11:20:40.916757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1355): Terminating (SIGTERM) 11:20:40.957281 --- ParallelTerminationStrategy: PID 1349 died... 11:20:40.976317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1349): Terminated: ok {rc=0} 11:20:41.021398 --- ParallelTerminationStrategy: PID 1352 died... 11:20:41.040322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1352): Terminated: ok {rc=0} 11:20:41.084666 --- ParallelTerminationStrategy: PID 1355 died... 11:20:41.103444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1355): Terminated: ok {rc=0} 11:20:41.187684 bus /sierra_3: Setting Powered False 11:20:42.285713 bus /sierra_3: Setting Powered False 11:20:43.402291 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 11:20:44.488691 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:44.500806 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:20:44.540558 tst emergency_preemptive_call.py: using LAC 28037 11:20:44.670451 tst emergency_preemptive_call.py: using RAC 242 11:20:44.792015 tst emergency_preemptive_call.py: using CellId 28037 11:20:44.912867 tst emergency_preemptive_call.py: using BVCI 28038 11:20:45.023651 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:45.034507 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:45.045192 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:45.056439 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:45.067808 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:20:45.079140 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:20:45.198914 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:20:45.318280 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:20:45.433282 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:20:45.548495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:46.078638 run create_hlr_db(pid=1358): Launched 11:20:46.246464 bus /sierra_2: Setting Powered False 11:20:47.309377 run create_hlr_db(pid=1358): Terminated: ok {rc=0} 11:20:47.747889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1360): Launched 11:20:48.056847 run osmo-hlr_10.42.42.2(pid=1361): Launched 11:20:48.174420 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:48.700814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1363): Launched 11:20:49.007769 run osmo-stp_10.42.42.5(pid=1364): Launched 11:20:49.133191 tst emergency_preemptive_call.py: using MSISDN 7713 11:20:49.288892 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:49.836155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1366): Launched 11:20:50.141593 run osmo-msc_10.42.42.6(pid=1367): Launched 11:20:50.318701 run osmo-stp_10.42.42.5(pid=1364): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1364)] 11:20:50.447370 run osmo-stp_10.42.42.5(pid=1364): stdout: | (launched: 2022-12-10_11:20:48.949142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:50.575764 run osmo-stp_10.42.42.5(pid=1364): stderr: | 20221210112049122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112049122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112049123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112049123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112049124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112049124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112049124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:50.701842 run osmo-stp_10.42.42.5(pid=1364): stdout: | (launched: 2022-12-10_11:20:48.949142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:50.823353 run osmo-stp_10.42.42.5(pid=1364): stderr: | 20221210112049122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112049122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112049123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112049123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112049124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112049124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112049124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:50.968349 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1364): Process ended prematurely: osmo-stp_10.42.42.5(pid=1364) [trial-2374↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1364)] [trial-2374↪emergency:sysmo↪emergency_preemptive_call.py:32] 11:20:50.976563 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 11:20:51.003010 run osmo-hlr_10.42.42.2(pid=1361): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1361)] 11:20:51.050979 run osmo-hlr_10.42.42.2(pid=1361): stdout: | (launched: 2022-12-10_11:20:47.998765) 11:20:51.100170 run osmo-hlr_10.42.42.2(pid=1361): stderr: | 20221210112048177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112048177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112048177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112048177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112048177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112048177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112048188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112048196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112048197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112048197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:51.168688 run osmo-msc_10.42.42.6(pid=1367): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1367)] 11:20:51.216207 run osmo-msc_10.42.42.6(pid=1367): stdout: | (launched: 2022-12-10_11:20:50.083664) 11:20:51.265300 run osmo-msc_10.42.42.6(pid=1367): stderr: | 20221210112050356 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112050356 DLGLOBAL DEBUG validating counter group 0x7fc3ec536c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112050356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112050356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112050356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112050356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112050358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112050359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112050359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112050359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:51.314881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1360): Terminating (SIGTERM) 11:20:51.354215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1363): Terminating (SIGTERM) 11:20:51.393624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1366): Terminating (SIGTERM) 11:20:51.433654 --- ParallelTerminationStrategy: PID 1360 died... 11:20:51.452537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1360): Terminated: ok {rc=0} 11:20:51.496560 --- ParallelTerminationStrategy: PID 1363 died... 11:20:51.514988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1363): Terminated: ok {rc=0} 11:20:51.559799 --- ParallelTerminationStrategy: PID 1366 died... 11:20:51.578424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1366): Terminated: ok {rc=0} 11:20:51.664601 bus /sierra_9: Setting Powered False 11:20:52.764925 bus /sierra_9: Setting Powered False 11:20:53.881195 bus /sierra_8: Setting Powered False 11:20:54.980182 bus /sierra_8: Setting Powered False 11:20:56.097633 bus /sierra_3: Setting Powered False 11:20:57.196881 bus /sierra_3: Setting Powered False 11:20:58.310716 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:sysmo --------------------------------------------------------------------- 11:20:59.573197 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:59.577930 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 11:20:59.599557 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 11:20:59.638678 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 11:20:59.729184 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 11:20:59.751023 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 11:20:59.790124 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 11:21:00.383495 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 11:21:00.438195 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:00.449181 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:21:00.483410 tst cs_paging_gprs_active.py: using LAC 28038 11:21:00.611821 tst cs_paging_gprs_active.py: using RAC 243 11:21:00.742566 tst cs_paging_gprs_active.py: using CellId 28038 11:21:00.879183 tst cs_paging_gprs_active.py: using BVCI 28039 11:21:01.013429 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.024760 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.036232 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.047570 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.059113 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.070894 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.082424 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.093999 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:01.105584 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:01.228900 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:01.376932 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:21:01.607700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:21:01.954431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1372): Launched 11:21:02.258899 run iperf3-srv_10.42.42.10(pid=1373): Launched 11:21:02.382891 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:21:02.607920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:21:02.943420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1374): Launched 11:21:03.232477 run iperf3-srv_10.42.42.10(pid=1375): Launched 11:21:03.355513 tst cs_paging_gprs_active.py:38: start network... 11:21:03.578113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:04.091594 run create_hlr_db(pid=1376): Launched 11:21:04.226093 bus /sierra_2: Setting Powered False 11:21:05.291830 run create_hlr_db(pid=1376): Terminated: ok {rc=0} 11:21:05.753337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1378): Launched 11:21:06.086435 run osmo-hlr_10.42.42.2(pid=1379): Launched 11:21:06.213513 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:06.783288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1381): Launched 11:21:07.116243 run osmo-stp_10.42.42.5(pid=1382): Launched 11:21:07.237604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:21:08.755407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1384): Launched 11:21:08.875230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:21:09.139920 run patchelf(pid=1385): Launched 11:21:09.312853 run osmo-stp_10.42.42.5(pid=1382): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1382)] 11:21:09.444942 run osmo-stp_10.42.42.5(pid=1382): stdout: | (launched: 2022-12-10_11:21:07.053298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:09.578188 run osmo-stp_10.42.42.5(pid=1382): stderr: | 20221210112107230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112107230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112107230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112107230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112107231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112107231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112107231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:09.711607 run osmo-stp_10.42.42.5(pid=1382): stdout: | (launched: 2022-12-10_11:21:07.053298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:09.839037 run osmo-stp_10.42.42.5(pid=1382): stderr: | 20221210112107230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112107230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112107230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112107230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112107231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112107231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112107231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:09.989866 run patchelf(pid=1385): Terminating (SIGINT) 11:21:10.164224 run patchelf(pid=1385): Terminated: ok {rc=0} 11:21:10.290181 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1382): Process ended prematurely: osmo-stp_10.42.42.5(pid=1382) [trial-2374↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1382)] [trial-2374↪gprs:sysmo↪cs_paging_gprs_active.py:38] 11:21:10.299718 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 11:21:10.328058 run osmo-hlr_10.42.42.2(pid=1379): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1379)] 11:21:10.376627 run osmo-hlr_10.42.42.2(pid=1379): stdout: | (launched: 2022-12-10_11:21:06.023605) 11:21:10.426749 run osmo-hlr_10.42.42.2(pid=1379): stderr: | 20221210112106228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112106228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112106228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112106228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112106228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112106229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112106241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112106249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112106249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112106249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:10.477385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1372): Terminating (SIGTERM) 11:21:10.518153 run iperf3-srv_10.42.42.10(pid=1373): Terminating (SIGTERM) 11:21:10.558786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1374): Terminating (SIGTERM) 11:21:10.599507 run iperf3-srv_10.42.42.10(pid=1375): Terminating (SIGTERM) 11:21:10.640219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1378): Terminating (SIGTERM) 11:21:10.681057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1381): Terminating (SIGTERM) 11:21:10.721889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1384): Terminating (SIGTERM) 11:21:10.762947 --- ParallelTerminationStrategy: PID 1372 died... 11:21:10.782257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1372): Terminated: ok {rc=0} 11:21:10.827772 --- ParallelTerminationStrategy: PID 1373 died... 11:21:10.846606 run iperf3-srv_10.42.42.10(pid=1373): Terminated {rc=256} 11:21:10.891561 --- ParallelTerminationStrategy: PID 1374 died... 11:21:10.910435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1374): Terminated: ok {rc=0} 11:21:10.955719 --- ParallelTerminationStrategy: PID 1375 died... 11:21:10.974581 run iperf3-srv_10.42.42.10(pid=1375): Terminated {rc=256} 11:21:11.019615 --- ParallelTerminationStrategy: PID 1378 died... 11:21:11.038588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1378): Terminated: ok {rc=0} 11:21:11.083891 --- ParallelTerminationStrategy: PID 1381 died... 11:21:11.102594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1381): Terminated: ok {rc=0} 11:21:11.147685 --- ParallelTerminationStrategy: PID 1384 died... 11:21:11.166508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1384): Terminated: ok {rc=0} 11:21:11.254429 bus /gobi_0: Setting Powered False 11:21:12.354754 bus /gobi_0: Setting Powered False 11:21:13.470268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo iperf3.py ---------------------------------------------- 11:21:14.623388 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:14.635066 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:21:14.675781 tst iperf3.py: using LAC 28039 11:21:14.804696 tst iperf3.py: using RAC 244 11:21:14.932619 tst iperf3.py: using CellId 28039 11:21:15.062832 tst iperf3.py: using BVCI 28040 11:21:15.185126 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.196304 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.207334 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.218205 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.228823 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.239543 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.250484 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.261305 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:15.272135 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:15.392639 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:21:15.616396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:21:15.954104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1387): Launched 11:21:16.271723 run iperf3-srv_10.42.42.10(pid=1388): Launched 11:21:16.450456 tst iperf3.py:8: start network... 11:21:16.739186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:17.268929 run create_hlr_db(pid=1389): Launched 11:21:17.423382 bus /gobi_6: Setting Powered False 11:21:18.488274 run create_hlr_db(pid=1389): Terminated: ok {rc=0} 11:21:18.930987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1391): Launched 11:21:19.242191 run osmo-hlr_10.42.42.2(pid=1392): Launched 11:21:19.361141 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:19.910000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1394): Launched 11:21:20.221942 run osmo-stp_10.42.42.5(pid=1395): Launched 11:21:20.340319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:21:20.875731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1397): Launched 11:21:20.994294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:21:21.258516 run patchelf(pid=1398): Launched 11:21:21.430776 run osmo-stp_10.42.42.5(pid=1395): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1395)] 11:21:21.561214 run osmo-stp_10.42.42.5(pid=1395): stdout: | (launched: 2022-12-10_11:21:20.162548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:21.693973 run osmo-stp_10.42.42.5(pid=1395): stderr: | 20221210112120336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112120336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112120337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112120337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112120338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112120338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112120338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:21.827164 run osmo-stp_10.42.42.5(pid=1395): stdout: | (launched: 2022-12-10_11:21:20.162548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:21.954133 run osmo-stp_10.42.42.5(pid=1395): stderr: | 20221210112120336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112120336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112120337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112120337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112120338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112120338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112120338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:22.104306 run patchelf(pid=1398): Terminating (SIGINT) 11:21:22.278075 run patchelf(pid=1398): Terminated: ok {rc=0} 11:21:22.403505 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1395): Process ended prematurely: osmo-stp_10.42.42.5(pid=1395) [trial-2374↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1395)] [trial-2374↪gprs:sysmo↪iperf3.py:8] 11:21:22.413600 tst iperf3.py:8: Test FAILED (7.8 sec) 11:21:22.440935 run osmo-hlr_10.42.42.2(pid=1392): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1392)] 11:21:22.489119 run osmo-hlr_10.42.42.2(pid=1392): stdout: | (launched: 2022-12-10_11:21:19.182908) 11:21:22.538868 run osmo-hlr_10.42.42.2(pid=1392): stderr: | 20221210112119363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112119363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112119363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112119363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112119363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112119363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112119375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112119383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112119383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112119384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:22.589128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1387): Terminating (SIGTERM) 11:21:22.629172 run iperf3-srv_10.42.42.10(pid=1388): Terminating (SIGTERM) 11:21:22.669076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1391): Terminating (SIGTERM) 11:21:22.709019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1394): Terminating (SIGTERM) 11:21:22.748899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1397): Terminating (SIGTERM) 11:21:22.788897 --- ParallelTerminationStrategy: PID 1387 died... 11:21:22.808004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1387): Terminated: ok {rc=0} 11:21:22.853127 --- ParallelTerminationStrategy: PID 1388 died... 11:21:22.871809 run iperf3-srv_10.42.42.10(pid=1388): Terminated {rc=256} 11:21:22.916806 --- ParallelTerminationStrategy: PID 1391 died... 11:21:22.935886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1391): Terminated: ok {rc=0} 11:21:22.980860 --- ParallelTerminationStrategy: PID 1394 died... 11:21:23.000040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1394): Terminated: ok {rc=0} 11:21:23.044572 --- ParallelTerminationStrategy: PID 1397 died... 11:21:23.063189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1397): Terminated: ok {rc=0} 11:21:23.148128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo iperf3m4.py ---------------------------------------------- 11:21:24.300723 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.312712 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:21:24.349745 tst iperf3m4.py: using LAC 28040 11:21:24.479844 tst iperf3m4.py: using RAC 245 11:21:24.611333 tst iperf3m4.py: using CellId 28040 11:21:24.740174 tst iperf3m4.py: using BVCI 28041 11:21:24.860428 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.871555 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.882470 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.893578 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.904389 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.915319 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.926486 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.937485 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:24.948634 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:25.069503 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:25.192086 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:25.310810 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:25.429283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:21:25.653352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:21:25.987752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1399): Launched 11:21:26.277376 run iperf3-srv_10.42.42.10(pid=1400): Launched 11:21:26.401136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:21:26.623944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:21:26.957705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1401): Launched 11:21:27.247348 run iperf3-srv_10.42.42.10(pid=1402): Launched 11:21:27.371860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:21:27.595421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:21:27.929332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1403): Launched 11:21:28.218649 run iperf3-srv_10.42.42.10(pid=1404): Launched 11:21:28.342085 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:21:28.564835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:21:28.898611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1405): Launched 11:21:29.203330 run iperf3-srv_10.42.42.10(pid=1406): Launched 11:21:29.327264 tst iperf3m4.py:8: start network... 11:21:29.550000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:30.064254 run create_hlr_db(pid=1407): Launched 11:21:30.196918 bus /gobi_6: Setting Powered False 11:21:31.282151 run create_hlr_db(pid=1407): Terminated: ok {rc=0} 11:21:31.807277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1409): Launched 11:21:32.141167 run osmo-hlr_10.42.42.2(pid=1410): Launched 11:21:32.303271 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:32.875057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1412): Launched 11:21:33.207292 run osmo-stp_10.42.42.5(pid=1413): Launched 11:21:33.333601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:21:33.905019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1415): Launched 11:21:34.031002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:21:34.312288 run patchelf(pid=1416): Launched 11:21:34.495568 run osmo-stp_10.42.42.5(pid=1413): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1413)] 11:21:34.635577 run osmo-stp_10.42.42.5(pid=1413): stdout: | (launched: 2022-12-10_11:21:33.145270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:34.777062 run osmo-stp_10.42.42.5(pid=1413): stderr: | 20221210112133341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112133341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112133342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112133342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112133342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112133343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112133343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:34.918928 run osmo-stp_10.42.42.5(pid=1413): stdout: | (launched: 2022-12-10_11:21:33.145270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:35.054250 run osmo-stp_10.42.42.5(pid=1413): stderr: | 20221210112133341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112133341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112133342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112133342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112133342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112133343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112133343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:35.214573 run patchelf(pid=1416): Terminating (SIGINT) 11:21:35.399832 run patchelf(pid=1416): Terminated: ok {rc=0} 11:21:35.532497 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1413): Process ended prematurely: osmo-stp_10.42.42.5(pid=1413) [trial-2374↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1413)] [trial-2374↪gprs:sysmo↪iperf3m4.py:8] 11:21:35.542506 tst iperf3m4.py:8: Test FAILED (11.3 sec) 11:21:35.571253 run osmo-hlr_10.42.42.2(pid=1410): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1410)] 11:21:35.621616 run osmo-hlr_10.42.42.2(pid=1410): stdout: | (launched: 2022-12-10_11:21:32.078942) 11:21:35.673728 run osmo-hlr_10.42.42.2(pid=1410): stderr: | 20221210112132318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112132318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112132318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112132318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112132318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112132318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112132331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112132341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112132341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112132341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:35.726211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1399): Terminating (SIGTERM) 11:21:35.768258 run iperf3-srv_10.42.42.10(pid=1400): Terminating (SIGTERM) 11:21:35.810760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1401): Terminating (SIGTERM) 11:21:35.852798 run iperf3-srv_10.42.42.10(pid=1402): Terminating (SIGTERM) 11:21:35.894932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1403): Terminating (SIGTERM) 11:21:35.936932 run iperf3-srv_10.42.42.10(pid=1404): Terminating (SIGTERM) 11:21:35.978870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1405): Terminating (SIGTERM) 11:21:36.020987 run iperf3-srv_10.42.42.10(pid=1406): Terminating (SIGTERM) 11:21:36.062865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1409): Terminating (SIGTERM) 11:21:36.105129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1412): Terminating (SIGTERM) 11:21:36.147167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1415): Terminating (SIGTERM) 11:21:36.189609 --- ParallelTerminationStrategy: PID 1399 died... 11:21:36.209779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1399): Terminated: ok {rc=0} 11:21:36.256700 --- ParallelTerminationStrategy: PID 1400 died... 11:21:36.276560 run iperf3-srv_10.42.42.10(pid=1400): Terminated {rc=256} 11:21:36.322928 --- ParallelTerminationStrategy: PID 1401 died... 11:21:36.342866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1401): Terminated: ok {rc=0} 11:21:36.389936 --- ParallelTerminationStrategy: PID 1402 died... 11:21:36.409831 run iperf3-srv_10.42.42.10(pid=1402): Terminated {rc=256} 11:21:36.456192 --- ParallelTerminationStrategy: PID 1403 died... 11:21:36.475984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1403): Terminated: ok {rc=0} 11:21:36.522425 --- ParallelTerminationStrategy: PID 1404 died... 11:21:36.542153 run iperf3-srv_10.42.42.10(pid=1404): Terminated {rc=256} 11:21:36.588561 --- ParallelTerminationStrategy: PID 1405 died... 11:21:36.608724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1405): Terminated: ok {rc=0} 11:21:36.655144 --- ParallelTerminationStrategy: PID 1406 died... 11:21:36.674893 run iperf3-srv_10.42.42.10(pid=1406): Terminated {rc=256} 11:21:36.721335 --- ParallelTerminationStrategy: PID 1409 died... 11:21:36.741256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1409): Terminated: ok {rc=0} 11:21:36.787799 --- ParallelTerminationStrategy: PID 1412 died... 11:21:36.807579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1412): Terminated: ok {rc=0} 11:21:36.854546 --- ParallelTerminationStrategy: PID 1415 died... 11:21:36.874587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1415): Terminated: ok {rc=0} 11:21:36.963186 bus /gobi_4: Setting Powered False 11:21:38.063549 bus /gobi_4: Setting Powered False 11:21:39.183395 bus /gobi_1: Setting Powered False 11:21:40.284393 bus /gobi_1: Setting Powered False 11:21:41.400658 bus /gobi_0: Setting Powered False 11:21:42.500449 bus /gobi_0: Setting Powered False 11:21:43.616498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo ping.py ---------------------------------------------- 11:21:44.721549 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:44.733438 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:21:44.770761 tst ping.py: using LAC 28041 11:21:44.901213 tst ping.py: using RAC 246 11:21:45.030262 tst ping.py: using CellId 28041 11:21:45.159036 tst ping.py: using BVCI 28042 11:21:45.278770 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:45.289807 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:45.301194 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:45.312218 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:45.323190 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:45.334065 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:45.345142 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:45.355999 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:45.476343 tst ping.py:19: start network... 11:21:45.695787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:46.215065 run create_hlr_db(pid=1417): Launched 11:21:46.377546 bus /gobi_6: Setting Powered False 11:21:47.442548 run create_hlr_db(pid=1417): Terminated: ok {rc=0} 11:21:47.879911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1419): Launched 11:21:48.187398 run osmo-hlr_10.42.42.2(pid=1420): Launched 11:21:48.303728 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:48.838433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1422): Launched 11:21:49.143562 run osmo-stp_10.42.42.5(pid=1423): Launched 11:21:49.258879 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:21:49.784336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1425): Launched 11:21:49.899863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:21:50.159016 run patchelf(pid=1426): Launched 11:21:50.327398 run osmo-stp_10.42.42.5(pid=1423): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1423)] 11:21:50.455879 run osmo-stp_10.42.42.5(pid=1423): stdout: | (launched: 2022-12-10_11:21:49.085761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:50.586445 run osmo-stp_10.42.42.5(pid=1423): stderr: | 20221210112149257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112149257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112149258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112149258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112149258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112149259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112149259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:50.716452 run osmo-stp_10.42.42.5(pid=1423): stdout: | (launched: 2022-12-10_11:21:49.085761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:50.840784 run osmo-stp_10.42.42.5(pid=1423): stderr: | 20221210112149257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112149257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112149258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112149258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112149258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112149259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112149259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:50.988185 run patchelf(pid=1426): Terminating (SIGINT) 11:21:51.158077 run patchelf(pid=1426): Terminated: ok {rc=0} 11:21:51.280575 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1423): Process ended prematurely: osmo-stp_10.42.42.5(pid=1423) [trial-2374↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1423)] [trial-2374↪gprs:sysmo↪ping.py:22] 11:21:51.289409 tst ping.py:22: Test FAILED (6.6 sec) 11:21:51.316603 run osmo-hlr_10.42.42.2(pid=1420): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1420)] 11:21:51.364700 run osmo-hlr_10.42.42.2(pid=1420): stdout: | (launched: 2022-12-10_11:21:48.129428) 11:21:51.414467 run osmo-hlr_10.42.42.2(pid=1420): stderr: | 20221210112148306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112148306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112148306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112148306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112148306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112148306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112148318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112148329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112148330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112148330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:51.464648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1419): Terminating (SIGTERM) 11:21:51.505664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1422): Terminating (SIGTERM) 11:21:51.546239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1425): Terminating (SIGTERM) 11:21:51.587008 --- ParallelTerminationStrategy: PID 1419 died... 11:21:51.606312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1419): Terminated: ok {rc=0} 11:21:51.651214 --- ParallelTerminationStrategy: PID 1422 died... 11:21:51.670009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1422): Terminated: ok {rc=0} 11:21:51.714879 --- ParallelTerminationStrategy: PID 1425 died... 11:21:51.733662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1425): Terminated: ok {rc=0} 11:21:51.820797 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 11:21:52.909923 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:52.921085 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:21:52.960892 tst ping_idle_ping.py: using LAC 28042 11:21:53.084605 tst ping_idle_ping.py: using RAC 247 11:21:53.203527 tst ping_idle_ping.py: using CellId 28042 11:21:53.322924 tst ping_idle_ping.py: using BVCI 28043 11:21:53.432880 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:53.443480 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:53.454060 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:53.464617 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:53.475260 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:53.486057 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:53.496662 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:21:53.507001 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:21:53.632580 tst ping_idle_ping.py:24: start network... 11:21:53.854999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:54.361681 run create_hlr_db(pid=1427): Launched 11:21:54.493348 bus /gobi_6: Setting Powered False 11:21:55.558526 run create_hlr_db(pid=1427): Terminated: ok {rc=0} 11:21:55.995957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Launched 11:21:56.303082 run osmo-hlr_10.42.42.2(pid=1430): Launched 11:21:56.419152 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:56.960110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Launched 11:21:57.266505 run osmo-stp_10.42.42.5(pid=1433): Launched 11:21:57.383477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:21:57.913516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1435): Launched 11:21:58.030327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:21:58.289844 run patchelf(pid=1436): Launched 11:21:58.458751 run osmo-stp_10.42.42.5(pid=1433): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] 11:21:58.587523 run osmo-stp_10.42.42.5(pid=1433): stdout: | (launched: 2022-12-10_11:21:57.208470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:58.718048 run osmo-stp_10.42.42.5(pid=1433): stderr: | 20221210112157381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112157381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112157382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112157382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112157382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112157383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112157383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:58.848496 run osmo-stp_10.42.42.5(pid=1433): stdout: | (launched: 2022-12-10_11:21:57.208470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:58.973233 run osmo-stp_10.42.42.5(pid=1433): stderr: | 20221210112157381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112157381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112157382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112157382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112157382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112157383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112157383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:59.120714 run patchelf(pid=1436): Terminating (SIGINT) 11:21:59.290939 run patchelf(pid=1436): Terminated: ok {rc=0} 11:21:59.413831 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1433): Process ended prematurely: osmo-stp_10.42.42.5(pid=1433) [trial-2374↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] [trial-2374↪gprs:sysmo↪ping_idle_ping.py:27] 11:21:59.422587 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:21:59.449568 run osmo-hlr_10.42.42.2(pid=1430): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1430)] 11:21:59.497164 run osmo-hlr_10.42.42.2(pid=1430): stdout: | (launched: 2022-12-10_11:21:56.244788) 11:21:59.546576 run osmo-hlr_10.42.42.2(pid=1430): stderr: | 20221210112156423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112156423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112156423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112156423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112156423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112156423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112156435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112156444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112156445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112156445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:59.596503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Terminating (SIGTERM) 11:21:59.636133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Terminating (SIGTERM) 11:21:59.675674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1435): Terminating (SIGTERM) 11:21:59.715718 --- ParallelTerminationStrategy: PID 1429 died... 11:21:59.734479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Terminated: ok {rc=0} 11:21:59.778491 --- ParallelTerminationStrategy: PID 1432 died... 11:21:59.796711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Terminated: ok {rc=0} 11:21:59.840900 --- ParallelTerminationStrategy: PID 1435 died... 11:21:59.859794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1435): Terminated: ok {rc=0} 11:21:59.945500 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 11:22:01.289322 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:22:01.298191 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:22:01.329371 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:22:01.372108 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:22:01.459872 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:22:01.481597 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:22:01.522132 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:22:02.140723 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:22:02.202258 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.214102 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:22:02.252405 tst cs_paging_gprs_active.py: using LAC 28043 11:22:02.373655 tst cs_paging_gprs_active.py: using RAC 248 11:22:02.497391 tst cs_paging_gprs_active.py: using CellId 28043 11:22:02.620170 tst cs_paging_gprs_active.py: using BVCI 28044 11:22:02.732849 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.743858 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.754446 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.765266 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.775998 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.786747 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.797643 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.808350 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:02.819352 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:02.938166 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:03.057534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:22:03.267700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:22:03.582161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1441): Launched 11:22:03.854844 run iperf3-srv_10.42.42.10(pid=1442): Launched 11:22:03.971178 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:22:04.180528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:22:04.494955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1443): Launched 11:22:04.767764 run iperf3-srv_10.42.42.10(pid=1444): Launched 11:22:04.884400 tst cs_paging_gprs_active.py:38: start network... 11:22:05.093470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:05.577385 run create_hlr_db(pid=1445): Launched 11:22:05.695842 bus /gobi_6: Setting Powered False 11:22:06.757178 run create_hlr_db(pid=1445): Terminated: ok {rc=0} 11:22:07.191507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1447): Launched 11:22:07.504288 run osmo-hlr_10.42.42.2(pid=1448): Launched 11:22:07.623254 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:08.173879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1450): Launched 11:22:08.486809 run osmo-stp_10.42.42.5(pid=1451): Launched 11:22:08.606061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:22:09.143564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1453): Launched 11:22:09.263160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:22:09.527411 run patchelf(pid=1454): Launched 11:22:09.699932 run osmo-stp_10.42.42.5(pid=1451): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1451)] 11:22:09.831390 run osmo-stp_10.42.42.5(pid=1451): stdout: | (launched: 2022-12-10_11:22:08.427358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:09.964311 run osmo-stp_10.42.42.5(pid=1451): stderr: | 20221210112208603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112208603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112208603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112208604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112208604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112208604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112208604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:10.097261 run osmo-stp_10.42.42.5(pid=1451): stdout: | (launched: 2022-12-10_11:22:08.427358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:10.224124 run osmo-stp_10.42.42.5(pid=1451): stderr: | 20221210112208603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112208603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112208603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112208604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112208604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112208604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112208604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:10.374785 run patchelf(pid=1454): Terminating (SIGINT) 11:22:10.548690 run patchelf(pid=1454): Terminated: ok {rc=0} 11:22:10.674121 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1451): Process ended prematurely: osmo-stp_10.42.42.5(pid=1451) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1451)] [trial-2374↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:22:10.683661 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:22:10.711379 run osmo-hlr_10.42.42.2(pid=1448): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1448)] 11:22:10.759712 run osmo-hlr_10.42.42.2(pid=1448): stdout: | (launched: 2022-12-10_11:22:07.445424) 11:22:10.809941 run osmo-hlr_10.42.42.2(pid=1448): stderr: | 20221210112207624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112207624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112207624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112207624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112207625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112207625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112207640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112207648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112207648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112207648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:10.860535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1441): Terminating (SIGTERM) 11:22:10.901127 run iperf3-srv_10.42.42.10(pid=1442): Terminating (SIGTERM) 11:22:10.941655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1443): Terminating (SIGTERM) 11:22:10.982169 run iperf3-srv_10.42.42.10(pid=1444): Terminating (SIGTERM) 11:22:11.022595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1447): Terminating (SIGTERM) 11:22:11.063211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1450): Terminating (SIGTERM) 11:22:11.103686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1453): Terminating (SIGTERM) 11:22:11.144525 --- ParallelTerminationStrategy: PID 1441 died... 11:22:11.163958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1441): Terminated: ok {rc=0} 11:22:11.209070 --- ParallelTerminationStrategy: PID 1442 died... 11:22:11.227598 run iperf3-srv_10.42.42.10(pid=1442): Terminated {rc=256} 11:22:11.272240 --- ParallelTerminationStrategy: PID 1443 died... 11:22:11.290997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1443): Terminated: ok {rc=0} 11:22:11.335998 --- ParallelTerminationStrategy: PID 1444 died... 11:22:11.354577 run iperf3-srv_10.42.42.10(pid=1444): Terminated {rc=256} 11:22:11.398975 --- ParallelTerminationStrategy: PID 1447 died... 11:22:11.417611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1447): Terminated: ok {rc=0} 11:22:11.461996 --- ParallelTerminationStrategy: PID 1450 died... 11:22:11.480679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1450): Terminated: ok {rc=0} 11:22:11.525375 --- ParallelTerminationStrategy: PID 1453 died... 11:22:11.544002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1453): Terminated: ok {rc=0} 11:22:11.632111 bus /gobi_0: Setting Powered False 11:22:12.731686 bus /gobi_0: Setting Powered False 11:22:13.848184 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:22:14.996403 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.008050 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:22:15.045357 tst iperf3.py: using LAC 28044 11:22:15.167888 tst iperf3.py: using RAC 249 11:22:15.290748 tst iperf3.py: using CellId 28044 11:22:15.411183 tst iperf3.py: using BVCI 28045 11:22:15.524800 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.535722 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.546567 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.557469 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.568056 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.578793 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.590216 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.601069 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:15.611990 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:15.734479 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:22:15.963071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:22:16.316101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1455): Launched 11:22:16.609809 run iperf3-srv_10.42.42.10(pid=1456): Launched 11:22:16.743057 tst iperf3.py:8: start network... 11:22:16.955495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:17.444531 run create_hlr_db(pid=1457): Launched 11:22:17.561424 bus /gobi_6: Setting Powered False 11:22:18.623324 run create_hlr_db(pid=1457): Terminated: ok {rc=0} 11:22:19.076652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Launched 11:22:19.409782 run osmo-hlr_10.42.42.2(pid=1460): Launched 11:22:19.535014 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:20.109658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Launched 11:22:20.441457 run osmo-stp_10.42.42.5(pid=1463): Launched 11:22:20.567816 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:22:21.140633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1465): Launched 11:22:21.268836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:22:21.550880 run patchelf(pid=1466): Launched 11:22:21.734993 run osmo-stp_10.42.42.5(pid=1463): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] 11:22:21.875327 run osmo-stp_10.42.42.5(pid=1463): stdout: | (launched: 2022-12-10_11:22:20.379103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:22.016814 run osmo-stp_10.42.42.5(pid=1463): stderr: | 20221210112220574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112220574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112220575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112220575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112220577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112220578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112220578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:22.158393 run osmo-stp_10.42.42.5(pid=1463): stdout: | (launched: 2022-12-10_11:22:20.379103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:22.293855 run osmo-stp_10.42.42.5(pid=1463): stderr: | 20221210112220574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112220574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112220575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112220575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112220577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112220578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112220578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:22.454221 run patchelf(pid=1466): Terminating (SIGINT) 11:22:22.639536 run patchelf(pid=1466): Terminated: ok {rc=0} 11:22:22.773114 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1463): Process ended prematurely: osmo-stp_10.42.42.5(pid=1463) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 11:22:22.783289 tst iperf3.py:8: Test FAILED (7.8 sec) 11:22:22.811996 run osmo-hlr_10.42.42.2(pid=1460): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1460)] 11:22:22.862948 run osmo-hlr_10.42.42.2(pid=1460): stdout: | (launched: 2022-12-10_11:22:19.347612) 11:22:22.915311 run osmo-hlr_10.42.42.2(pid=1460): stderr: | 20221210112219550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112219550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112219550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112219550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112219550 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112219550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112219563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112219573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112219573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112219573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:22.968030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1455): Terminating (SIGTERM) 11:22:23.010152 run iperf3-srv_10.42.42.10(pid=1456): Terminating (SIGTERM) 11:22:23.052160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Terminating (SIGTERM) 11:22:23.094498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Terminating (SIGTERM) 11:22:23.136477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1465): Terminating (SIGTERM) 11:22:23.178763 --- ParallelTerminationStrategy: PID 1455 died... 11:22:23.198629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1455): Terminated: ok {rc=0} 11:22:23.245162 --- ParallelTerminationStrategy: PID 1456 died... 11:22:23.264586 run iperf3-srv_10.42.42.10(pid=1456): Terminated {rc=256} 11:22:23.310681 --- ParallelTerminationStrategy: PID 1459 died... 11:22:23.330120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Terminated: ok {rc=0} 11:22:23.375938 --- ParallelTerminationStrategy: PID 1462 died... 11:22:23.395433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Terminated: ok {rc=0} 11:22:23.441823 --- ParallelTerminationStrategy: PID 1465 died... 11:22:23.461475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1465): Terminated: ok {rc=0} 11:22:23.550018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:22:24.698688 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:24.710194 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:22:24.748018 tst iperf3m4.py: using LAC 28045 11:22:24.875263 tst iperf3m4.py: using RAC 250 11:22:24.995781 tst iperf3m4.py: using CellId 28045 11:22:25.115260 tst iperf3m4.py: using BVCI 28046 11:22:25.227256 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.238077 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.248755 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.259678 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.270539 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.281321 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.292159 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.302892 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:25.313835 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:25.430359 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:25.552903 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:25.671811 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:25.790737 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:22:26.015471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:22:26.351379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1467): Launched 11:22:26.641130 run iperf3-srv_10.42.42.10(pid=1468): Launched 11:22:26.764749 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:22:26.988308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:22:27.322898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1469): Launched 11:22:27.612880 run iperf3-srv_10.42.42.10(pid=1470): Launched 11:22:27.736874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:22:27.961539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:22:28.295651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1471): Launched 11:22:28.586145 run iperf3-srv_10.42.42.10(pid=1472): Launched 11:22:28.709987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:22:28.933720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:22:29.268232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1473): Launched 11:22:29.558181 run iperf3-srv_10.42.42.10(pid=1474): Launched 11:22:29.683762 tst iperf3m4.py:8: start network... 11:22:29.908341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:30.422611 run create_hlr_db(pid=1475): Launched 11:22:30.556320 bus /gobi_6: Setting Powered False 11:22:31.622892 run create_hlr_db(pid=1475): Terminated: ok {rc=0} 11:22:32.164721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1477): Launched 11:22:32.512365 run osmo-hlr_10.42.42.2(pid=1478): Launched 11:22:32.639247 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:33.208435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1480): Launched 11:22:33.540866 run osmo-stp_10.42.42.5(pid=1481): Launched 11:22:33.665974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:22:34.237375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1483): Launched 11:22:34.363299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:22:34.644627 run patchelf(pid=1484): Launched 11:22:34.827768 run osmo-stp_10.42.42.5(pid=1481): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1481)] 11:22:34.967197 run osmo-stp_10.42.42.5(pid=1481): stdout: | (launched: 2022-12-10_11:22:33.478440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:35.107753 run osmo-stp_10.42.42.5(pid=1481): stderr: | 20221210112233675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112233675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112233675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112233676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112233676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112233676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112233676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:35.248678 run osmo-stp_10.42.42.5(pid=1481): stdout: | (launched: 2022-12-10_11:22:33.478440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:35.383219 run osmo-stp_10.42.42.5(pid=1481): stderr: | 20221210112233675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112233675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112233675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112233676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112233676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112233676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112233676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:35.543249 run patchelf(pid=1484): Terminating (SIGINT) 11:22:35.727549 run patchelf(pid=1484): Terminated: ok {rc=0} 11:22:35.861106 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1481): Process ended prematurely: osmo-stp_10.42.42.5(pid=1481) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1481)] [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 11:22:35.871130 tst iperf3m4.py:8: Test FAILED (11.2 sec) 11:22:35.899870 run osmo-hlr_10.42.42.2(pid=1478): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1478)] 11:22:35.950080 run osmo-hlr_10.42.42.2(pid=1478): stdout: | (launched: 2022-12-10_11:22:32.449892) 11:22:36.003963 run osmo-hlr_10.42.42.2(pid=1478): stderr: | 20221210112232650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112232650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112232651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112232651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112232651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112232651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112232664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112232672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112232672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112232672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:36.056057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1467): Terminating (SIGTERM) 11:22:36.097887 run iperf3-srv_10.42.42.10(pid=1468): Terminating (SIGTERM) 11:22:36.139464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1469): Terminating (SIGTERM) 11:22:36.181380 run iperf3-srv_10.42.42.10(pid=1470): Terminating (SIGTERM) 11:22:36.222923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1471): Terminating (SIGTERM) 11:22:36.264519 run iperf3-srv_10.42.42.10(pid=1472): Terminating (SIGTERM) 11:22:36.306163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1473): Terminating (SIGTERM) 11:22:36.347864 run iperf3-srv_10.42.42.10(pid=1474): Terminating (SIGTERM) 11:22:36.389480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1477): Terminating (SIGTERM) 11:22:36.431154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1480): Terminating (SIGTERM) 11:22:36.472919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1483): Terminating (SIGTERM) 11:22:36.514660 --- ParallelTerminationStrategy: PID 1467 died... 11:22:36.534590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1467): Terminated: ok {rc=0} 11:22:36.581078 --- ParallelTerminationStrategy: PID 1468 died... 11:22:36.600542 run iperf3-srv_10.42.42.10(pid=1468): Terminated {rc=256} 11:22:36.646506 --- ParallelTerminationStrategy: PID 1469 died... 11:22:36.666200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1469): Terminated: ok {rc=0} 11:22:36.712108 --- ParallelTerminationStrategy: PID 1470 died... 11:22:36.731709 run iperf3-srv_10.42.42.10(pid=1470): Terminated {rc=256} 11:22:36.777577 --- ParallelTerminationStrategy: PID 1471 died... 11:22:36.797215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1471): Terminated: ok {rc=0} 11:22:36.843380 --- ParallelTerminationStrategy: PID 1472 died... 11:22:36.863050 run iperf3-srv_10.42.42.10(pid=1472): Terminated {rc=256} 11:22:36.909413 --- ParallelTerminationStrategy: PID 1473 died... 11:22:36.929148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1473): Terminated: ok {rc=0} 11:22:36.975189 --- ParallelTerminationStrategy: PID 1474 died... 11:22:36.994836 run iperf3-srv_10.42.42.10(pid=1474): Terminated {rc=256} 11:22:37.040886 --- ParallelTerminationStrategy: PID 1477 died... 11:22:37.060919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1477): Terminated: ok {rc=0} 11:22:37.107145 --- ParallelTerminationStrategy: PID 1480 died... 11:22:37.126798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1480): Terminated: ok {rc=0} 11:22:37.172826 --- ParallelTerminationStrategy: PID 1483 died... 11:22:37.192802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1483): Terminated: ok {rc=0} 11:22:37.281152 bus /gobi_4: Setting Powered False 11:22:38.380556 bus /gobi_4: Setting Powered False 11:22:39.497447 bus /gobi_1: Setting Powered False 11:22:40.597444 bus /gobi_1: Setting Powered False 11:22:41.714007 bus /gobi_0: Setting Powered False 11:22:42.811932 bus /gobi_0: Setting Powered False 11:22:43.931288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 11:22:45.034381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.046081 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:22:45.083940 tst ping.py: using LAC 28046 11:22:45.203940 tst ping.py: using RAC 251 11:22:45.324820 tst ping.py: using CellId 28046 11:22:45.456933 tst ping.py: using BVCI 28047 11:22:45.575952 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.587435 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.598728 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.609976 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.620933 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.632089 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.643221 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:45.654308 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:45.771513 tst ping.py:19: start network... 11:22:45.995882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:46.522199 run create_hlr_db(pid=1486): Launched 11:22:46.686149 bus /gobi_6: Setting Powered False 11:22:47.750750 run create_hlr_db(pid=1486): Terminated: ok {rc=0} 11:22:48.208128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1488): Launched 11:22:48.535163 run osmo-hlr_10.42.42.2(pid=1489): Launched 11:22:48.658677 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:49.218976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1491): Launched 11:22:49.545595 run osmo-stp_10.42.42.5(pid=1492): Launched 11:22:49.669507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:22:50.234134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1494): Launched 11:22:50.357901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:22:50.634477 run patchelf(pid=1495): Launched 11:22:50.814664 run osmo-stp_10.42.42.5(pid=1492): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1492)] 11:22:50.952089 run osmo-stp_10.42.42.5(pid=1492): stdout: | (launched: 2022-12-10_11:22:49.484301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:51.091070 run osmo-stp_10.42.42.5(pid=1492): stderr: | 20221210112249679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112249679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112249679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112249680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112249680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112249680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112249680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:51.229697 run osmo-stp_10.42.42.5(pid=1492): stdout: | (launched: 2022-12-10_11:22:49.484301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:51.362572 run osmo-stp_10.42.42.5(pid=1492): stderr: | 20221210112249679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112249679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112249679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112249680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112249680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112249680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112249680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:51.519982 run patchelf(pid=1495): Terminating (SIGINT) 11:22:51.701171 run patchelf(pid=1495): Terminated: ok {rc=0} 11:22:51.831432 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1492): Process ended prematurely: osmo-stp_10.42.42.5(pid=1492) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1492)] [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 11:22:51.840884 tst ping.py:22: Test FAILED (6.8 sec) 11:22:51.869543 run osmo-hlr_10.42.42.2(pid=1489): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1489)] 11:22:51.920222 run osmo-hlr_10.42.42.2(pid=1489): stdout: | (launched: 2022-12-10_11:22:48.473375) 11:22:51.972665 run osmo-hlr_10.42.42.2(pid=1489): stderr: | 20221210112248674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112248675 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112248675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112248675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112248675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112248675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112248687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112248697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112248697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112248697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:52.025330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1488): Terminating (SIGTERM) 11:22:52.067365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1491): Terminating (SIGTERM) 11:22:52.109714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1494): Terminating (SIGTERM) 11:22:52.152108 --- ParallelTerminationStrategy: PID 1488 died... 11:22:52.172332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1488): Terminated: ok {rc=0} 11:22:52.219249 --- ParallelTerminationStrategy: PID 1491 died... 11:22:52.239045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1491): Terminated: ok {rc=0} 11:22:52.285656 --- ParallelTerminationStrategy: PID 1494 died... 11:22:52.305533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1494): Terminated: ok {rc=0} 11:22:52.393740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:22:53.482469 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:53.494183 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:22:53.534050 tst ping_idle_ping.py: using LAC 28047 11:22:53.661896 tst ping_idle_ping.py: using RAC 252 11:22:53.783109 tst ping_idle_ping.py: using CellId 28047 11:22:53.904411 tst ping_idle_ping.py: using BVCI 28048 11:22:54.018454 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:54.029514 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:54.040410 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:54.051589 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:54.062733 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:54.073800 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:54.084880 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:22:54.095909 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:22:54.221829 tst ping_idle_ping.py:24: start network... 11:22:54.437311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:54.910887 run create_hlr_db(pid=1496): Launched 11:22:55.026010 bus /gobi_6: Setting Powered False 11:22:56.087209 run create_hlr_db(pid=1496): Terminated: ok {rc=0} 11:22:56.533840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1498): Launched 11:22:56.842426 run osmo-hlr_10.42.42.2(pid=1499): Launched 11:22:56.958930 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:57.483464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1501): Launched 11:22:57.790539 run osmo-stp_10.42.42.5(pid=1502): Launched 11:22:57.907419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:22:58.438170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1504): Launched 11:22:58.554702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:22:58.815248 run patchelf(pid=1505): Launched 11:22:58.984731 run osmo-stp_10.42.42.5(pid=1502): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1502)] 11:22:59.113849 run osmo-stp_10.42.42.5(pid=1502): stdout: | (launched: 2022-12-10_11:22:57.732630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:59.244543 run osmo-stp_10.42.42.5(pid=1502): stderr: | 20221210112257905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112257905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112257905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112257905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112257906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112257906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112257906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:59.374829 run osmo-stp_10.42.42.5(pid=1502): stdout: | (launched: 2022-12-10_11:22:57.732630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:59.499488 run osmo-stp_10.42.42.5(pid=1502): stderr: | 20221210112257905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112257905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112257905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112257905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112257906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112257906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112257906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:59.647286 run patchelf(pid=1505): Terminating (SIGINT) 11:22:59.817724 run patchelf(pid=1505): Terminated: ok {rc=0} 11:22:59.940731 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1502): Process ended prematurely: osmo-stp_10.42.42.5(pid=1502) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1502)] [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 11:22:59.949903 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:22:59.977103 run osmo-hlr_10.42.42.2(pid=1499): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1499)] 11:23:00.025607 run osmo-hlr_10.42.42.2(pid=1499): stdout: | (launched: 2022-12-10_11:22:56.784248) 11:23:00.075651 run osmo-hlr_10.42.42.2(pid=1499): stderr: | 20221210112256964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112256964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112256964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112256964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112256964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112256964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112256976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112256985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112256985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112256986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:00.126069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1498): Terminating (SIGTERM) 11:23:00.166483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1501): Terminating (SIGTERM) 11:23:00.206798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1504): Terminating (SIGTERM) 11:23:00.247472 --- ParallelTerminationStrategy: PID 1498 died... 11:23:00.266657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1498): Terminated: ok {rc=0} 11:23:00.312063 --- ParallelTerminationStrategy: PID 1501 died... 11:23:00.330817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1501): Terminated: ok {rc=0} 11:23:00.375287 --- ParallelTerminationStrategy: PID 1504 died... 11:23:00.394044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1504): Terminated: ok {rc=0} 11:23:00.478116 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:23:01.816926 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:01.827292 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:23:01.863888 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:23:01.915617 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:23:02.023025 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:23:02.046204 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:23:02.087605 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:23:02.680683 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:23:02.734016 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:02.745504 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:23:02.803620 tst cs_paging_gprs_active.py: using LAC 28048 11:23:02.933019 tst cs_paging_gprs_active.py: using RAC 253 11:23:03.063730 tst cs_paging_gprs_active.py: using CellId 28048 11:23:03.192932 tst cs_paging_gprs_active.py: using BVCI 28049 11:23:03.312679 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.324107 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.335286 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.346496 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.357601 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.368595 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.379806 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.390839 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:03.402202 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:03.521744 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:03.644025 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:23:03.869802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:04.205689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1509): Launched 11:23:04.496078 run iperf3-srv_10.42.42.10(pid=1510): Launched 11:23:04.620468 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:23:04.844704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:05.180595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1511): Launched 11:23:05.471012 run iperf3-srv_10.42.42.10(pid=1512): Launched 11:23:05.595163 tst cs_paging_gprs_active.py:38: start network... 11:23:05.819475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:06.337398 run create_hlr_db(pid=1513): Launched 11:23:06.471344 bus /gobi_6: Setting Powered False 11:23:07.536918 run create_hlr_db(pid=1513): Terminated: ok {rc=0} 11:23:07.983346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Launched 11:23:08.298872 run osmo-hlr_10.42.42.2(pid=1516): Launched 11:23:08.419362 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:08.962581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Launched 11:23:09.277295 run osmo-stp_10.42.42.5(pid=1519): Launched 11:23:09.396392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:23:09.936506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1521): Launched 11:23:10.056160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:23:10.322850 run patchelf(pid=1522): Launched 11:23:10.498098 run osmo-stp_10.42.42.5(pid=1519): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] 11:23:10.629503 run osmo-stp_10.42.42.5(pid=1519): stdout: | (launched: 2022-12-10_11:23:09.218086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:10.762579 run osmo-stp_10.42.42.5(pid=1519): stderr: | 20221210112309394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112309394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112309394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112309394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112309395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112309395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112309395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:10.895581 run osmo-stp_10.42.42.5(pid=1519): stdout: | (launched: 2022-12-10_11:23:09.218086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:11.022235 run osmo-stp_10.42.42.5(pid=1519): stderr: | 20221210112309394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112309394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112309394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112309394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112309395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112309395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112309395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:11.173192 run patchelf(pid=1522): Terminating (SIGINT) 11:23:11.347001 run patchelf(pid=1522): Terminated: ok {rc=0} 11:23:11.472333 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1519): Process ended prematurely: osmo-stp_10.42.42.5(pid=1519) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:23:11.481801 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:23:11.509472 run osmo-hlr_10.42.42.2(pid=1516): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1516)] 11:23:11.557946 run osmo-hlr_10.42.42.2(pid=1516): stdout: | (launched: 2022-12-10_11:23:08.239671) 11:23:11.608018 run osmo-hlr_10.42.42.2(pid=1516): stderr: | 20221210112308420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112308420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112308420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112308420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112308420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112308420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112308432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112308440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112308441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112308441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:11.658476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1509): Terminating (SIGTERM) 11:23:11.699412 run iperf3-srv_10.42.42.10(pid=1510): Terminating (SIGTERM) 11:23:11.739759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1511): Terminating (SIGTERM) 11:23:11.779796 run iperf3-srv_10.42.42.10(pid=1512): Terminating (SIGTERM) 11:23:11.820625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Terminating (SIGTERM) 11:23:11.860853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Terminating (SIGTERM) 11:23:11.901359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1521): Terminating (SIGTERM) 11:23:11.941654 --- ParallelTerminationStrategy: PID 1509 died... 11:23:11.960677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1509): Terminated: ok {rc=0} 11:23:12.005540 --- ParallelTerminationStrategy: PID 1510 died... 11:23:12.024266 run iperf3-srv_10.42.42.10(pid=1510): Terminated {rc=256} 11:23:12.068802 --- ParallelTerminationStrategy: PID 1511 died... 11:23:12.088026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1511): Terminated: ok {rc=0} 11:23:12.133092 --- ParallelTerminationStrategy: PID 1512 died... 11:23:12.151824 run iperf3-srv_10.42.42.10(pid=1512): Terminated {rc=256} 11:23:12.196353 --- ParallelTerminationStrategy: PID 1515 died... 11:23:12.215358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Terminated: ok {rc=0} 11:23:12.259762 --- ParallelTerminationStrategy: PID 1518 died... 11:23:12.278406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Terminated: ok {rc=0} 11:23:12.322908 --- ParallelTerminationStrategy: PID 1521 died... 11:23:12.341679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1521): Terminated: ok {rc=0} 11:23:12.426007 bus /gobi_0: Setting Powered False 11:23:13.525394 bus /gobi_0: Setting Powered False 11:23:14.642645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:23:15.793911 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:15.806109 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:23:15.881071 tst iperf3.py: using LAC 28049 11:23:16.019899 tst iperf3.py: using RAC 254 11:23:16.152523 tst iperf3.py: using CellId 28049 11:23:16.287551 tst iperf3.py: using BVCI 28050 11:23:16.406930 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.418717 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.430191 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.450392 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.466845 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.480100 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.497349 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.510280 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:16.524586 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:16.665823 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:23:16.952384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:17.366762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1560): Launched 11:23:17.737888 run iperf3-srv_10.42.42.10(pid=1573): Launched 11:23:17.894145 tst iperf3.py:8: start network... 11:23:18.155361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:18.743606 run create_hlr_db(pid=1648): Launched 11:23:18.933325 bus /gobi_6: Setting Powered False 11:23:20.000733 run create_hlr_db(pid=1648): Terminated: ok {rc=0} 11:23:20.483728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1798): Launched 11:23:20.816629 run osmo-hlr_10.42.42.2(pid=1799): Launched 11:23:21.048928 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:21.813686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1803): Launched 11:23:22.143207 run osmo-stp_10.42.42.5(pid=1804): Launched 11:23:22.386295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:23:23.095658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1806): Launched 11:23:23.228524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:23:23.501665 run patchelf(pid=1807): Launched 11:23:23.692348 run osmo-stp_10.42.42.5(pid=1804): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1804)] 11:23:23.826515 run osmo-stp_10.42.42.5(pid=1804): stdout: | (launched: 2022-12-10_11:23:22.079650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:23.962543 run osmo-stp_10.42.42.5(pid=1804): stderr: | 20221210112322422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112322422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112322422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112322422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112322423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112322423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112322423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:24.099232 run osmo-stp_10.42.42.5(pid=1804): stdout: | (launched: 2022-12-10_11:23:22.079650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:24.231406 run osmo-stp_10.42.42.5(pid=1804): stderr: | 20221210112322422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112322422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112322422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112322422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112322423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112322423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112322423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:24.387790 run patchelf(pid=1807): Terminating (SIGINT) 11:23:24.567812 run patchelf(pid=1807): Terminated: ok {rc=0} 11:23:24.697533 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1804): Process ended prematurely: osmo-stp_10.42.42.5(pid=1804) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1804)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 11:23:24.708157 tst iperf3.py:8: Test FAILED (9.0 sec) 11:23:24.739576 run osmo-hlr_10.42.42.2(pid=1799): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1799)] 11:23:24.790908 run osmo-hlr_10.42.42.2(pid=1799): stdout: | (launched: 2022-12-10_11:23:20.754085) 11:23:24.843874 run osmo-hlr_10.42.42.2(pid=1799): stderr: | 20221210112321109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112321109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112321110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112321110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112321110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112321110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112321123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112321141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112321141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112321141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:24.897967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1560): Terminating (SIGTERM) 11:23:24.941986 run iperf3-srv_10.42.42.10(pid=1573): Terminating (SIGTERM) 11:23:24.988475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1798): Terminating (SIGTERM) 11:23:25.032463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1803): Terminating (SIGTERM) 11:23:25.077859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1806): Terminating (SIGTERM) 11:23:25.123532 --- ParallelTerminationStrategy: PID 1560 died... 11:23:25.143982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1560): Terminated: ok {rc=0} 11:23:25.194197 --- ParallelTerminationStrategy: PID 1573 died... 11:23:25.214574 run iperf3-srv_10.42.42.10(pid=1573): Terminated {rc=256} 11:23:25.263274 --- ParallelTerminationStrategy: PID 1798 died... 11:23:25.283347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1798): Terminated: ok {rc=0} 11:23:25.332175 --- ParallelTerminationStrategy: PID 1803 died... 11:23:25.352286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1803): Terminated: ok {rc=0} 11:23:25.401204 --- ParallelTerminationStrategy: PID 1806 died... 11:23:25.421280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1806): Terminated: ok {rc=0} 11:23:25.511319 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:23:26.667967 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:26.680758 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:23:26.741353 tst iperf3m4.py: using LAC 28050 11:23:26.866784 tst iperf3m4.py: using RAC 255 11:23:26.993644 tst iperf3m4.py: using CellId 28050 11:23:27.118355 tst iperf3m4.py: using BVCI 28051 11:23:27.238289 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.250506 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.262432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.275023 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.287717 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.301514 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.314869 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.326512 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:27.341772 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:27.463699 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:27.590833 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:27.712583 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:27.833169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:23:28.052142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:28.382635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1808): Launched 11:23:28.679813 run iperf3-srv_10.42.42.10(pid=1809): Launched 11:23:28.815688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:23:29.032794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:29.361781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1810): Launched 11:23:29.660727 run iperf3-srv_10.42.42.10(pid=1811): Launched 11:23:29.797516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:23:30.014854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:30.343072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1812): Launched 11:23:30.639734 run iperf3-srv_10.42.42.10(pid=1813): Launched 11:23:30.776515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:23:31.018741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:31.371786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1815): Launched 11:23:31.729576 run iperf3-srv_10.42.42.10(pid=1816): Launched 11:23:31.897497 tst iperf3m4.py:8: start network... 11:23:32.182074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:32.784444 run create_hlr_db(pid=1817): Launched 11:23:32.955295 bus /gobi_6: Setting Powered False 11:23:34.018477 run create_hlr_db(pid=1817): Terminated: ok {rc=0} 11:23:34.509555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1820): Launched 11:23:34.850062 run osmo-hlr_10.42.42.2(pid=1821): Launched 11:23:35.093061 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:35.854102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1823): Launched 11:23:36.198225 run osmo-stp_10.42.42.5(pid=1824): Launched 11:23:36.443267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:23:37.195856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1826): Launched 11:23:37.330667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:23:37.612118 run patchelf(pid=1827): Launched 11:23:37.806404 run osmo-stp_10.42.42.5(pid=1824): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1824)] 11:23:37.943988 run osmo-stp_10.42.42.5(pid=1824): stdout: | (launched: 2022-12-10_11:23:36.134013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:38.082321 run osmo-stp_10.42.42.5(pid=1824): stderr: | 20221210112336480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112336480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112336480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112336480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112336488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112336488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112336488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:38.221517 run osmo-stp_10.42.42.5(pid=1824): stdout: | (launched: 2022-12-10_11:23:36.134013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:38.355501 run osmo-stp_10.42.42.5(pid=1824): stderr: | 20221210112336480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112336480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112336480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112336480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112336488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112336488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112336488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:38.512122 run patchelf(pid=1827): Terminating (SIGINT) 11:23:38.695694 run patchelf(pid=1827): Terminated: ok {rc=0} 11:23:38.827559 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1824): Process ended prematurely: osmo-stp_10.42.42.5(pid=1824) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1824)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:23:38.838334 tst iperf3m4.py:8: Test FAILED (12.2 sec) 11:23:38.870208 run osmo-hlr_10.42.42.2(pid=1821): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1821)] 11:23:38.922024 run osmo-hlr_10.42.42.2(pid=1821): stdout: | (launched: 2022-12-10_11:23:34.787257) 11:23:38.976197 run osmo-hlr_10.42.42.2(pid=1821): stderr: | 20221210112335142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112335142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112335142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112335142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112335142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112335142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112335162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112335174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112335175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112335175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:39.030354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1808): Terminating (SIGTERM) 11:23:39.074135 run iperf3-srv_10.42.42.10(pid=1809): Terminating (SIGTERM) 11:23:39.121237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1810): Terminating (SIGTERM) 11:23:39.166359 run iperf3-srv_10.42.42.10(pid=1811): Terminating (SIGTERM) 11:23:39.213136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1812): Terminating (SIGTERM) 11:23:39.257176 run iperf3-srv_10.42.42.10(pid=1813): Terminating (SIGTERM) 11:23:39.303456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1815): Terminating (SIGTERM) 11:23:39.349374 run iperf3-srv_10.42.42.10(pid=1816): Terminating (SIGTERM) 11:23:39.395488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1820): Terminating (SIGTERM) 11:23:39.440001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1823): Terminating (SIGTERM) 11:23:39.484214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1826): Terminating (SIGTERM) 11:23:39.531700 --- ParallelTerminationStrategy: PID 1808 died... 11:23:39.553057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1808): Terminated: ok {rc=0} 11:23:39.604497 --- ParallelTerminationStrategy: PID 1809 died... 11:23:39.624778 run iperf3-srv_10.42.42.10(pid=1809): Terminated {rc=256} 11:23:39.673461 --- ParallelTerminationStrategy: PID 1810 died... 11:23:39.693622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1810): Terminated: ok {rc=0} 11:23:39.743821 --- ParallelTerminationStrategy: PID 1811 died... 11:23:39.764119 run iperf3-srv_10.42.42.10(pid=1811): Terminated {rc=256} 11:23:39.812825 --- ParallelTerminationStrategy: PID 1812 died... 11:23:39.833236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1812): Terminated: ok {rc=0} 11:23:39.882369 --- ParallelTerminationStrategy: PID 1813 died... 11:23:39.902737 run iperf3-srv_10.42.42.10(pid=1813): Terminated {rc=256} 11:23:39.953422 --- ParallelTerminationStrategy: PID 1815 died... 11:23:39.973815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1815): Terminated: ok {rc=0} 11:23:40.023052 --- ParallelTerminationStrategy: PID 1816 died... 11:23:40.043117 run iperf3-srv_10.42.42.10(pid=1816): Terminated {rc=256} 11:23:40.092222 --- ParallelTerminationStrategy: PID 1820 died... 11:23:40.112404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1820): Terminated: ok {rc=0} 11:23:40.166090 --- ParallelTerminationStrategy: PID 1823 died... 11:23:40.186243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1823): Terminated: ok {rc=0} 11:23:40.235134 --- ParallelTerminationStrategy: PID 1826 died... 11:23:40.255345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1826): Terminated: ok {rc=0} 11:23:40.352028 bus /gobi_4: Setting Powered False 11:23:41.453395 bus /gobi_4: Setting Powered False 11:23:42.570156 bus /gobi_1: Setting Powered False 11:23:43.671336 bus /gobi_1: Setting Powered False 11:23:44.789047 bus /gobi_0: Setting Powered False 11:23:45.905578 bus /gobi_0: Setting Powered False 11:23:47.027049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:23:48.131311 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.143074 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:23:48.199940 tst ping.py: using LAC 28051 11:23:48.318861 tst ping.py: using RAC 1 11:23:48.440829 tst ping.py: using CellId 28051 11:23:48.561570 tst ping.py: using BVCI 28052 11:23:48.683043 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.694694 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.706069 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.717802 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.728933 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.740181 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.752668 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:48.764119 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:48.881335 tst ping.py:19: start network... 11:23:49.086851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:49.561949 run create_hlr_db(pid=1828): Launched 11:23:49.679324 bus /gobi_6: Setting Powered False 11:23:50.739785 run create_hlr_db(pid=1828): Terminated: ok {rc=0} 11:23:51.189135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1830): Launched 11:23:51.517000 run osmo-hlr_10.42.42.2(pid=1831): Launched 11:23:51.641937 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:52.211764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1833): Launched 11:23:52.538979 run osmo-stp_10.42.42.5(pid=1834): Launched 11:23:52.663123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:23:53.225267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1836): Launched 11:23:53.348748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:23:53.625065 run patchelf(pid=1837): Launched 11:23:53.804901 run osmo-stp_10.42.42.5(pid=1834): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1834)] 11:23:53.942019 run osmo-stp_10.42.42.5(pid=1834): stdout: | (launched: 2022-12-10_11:23:52.477530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:54.080057 run osmo-stp_10.42.42.5(pid=1834): stderr: | 20221210112352673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112352673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112352673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112352674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112352676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112352676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112352676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:54.218821 run osmo-stp_10.42.42.5(pid=1834): stdout: | (launched: 2022-12-10_11:23:52.477530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:54.351532 run osmo-stp_10.42.42.5(pid=1834): stderr: | 20221210112352673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112352673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112352673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112352674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112352676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112352676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112352676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:54.509666 run patchelf(pid=1837): Terminating (SIGINT) 11:23:54.690071 run patchelf(pid=1837): Terminated: ok {rc=0} 11:23:54.819706 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1834): Process ended prematurely: osmo-stp_10.42.42.5(pid=1834) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1834)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 11:23:54.829076 tst ping.py:22: Test FAILED (6.7 sec) 11:23:54.857100 run osmo-hlr_10.42.42.2(pid=1831): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1831)] 11:23:54.907295 run osmo-hlr_10.42.42.2(pid=1831): stdout: | (launched: 2022-12-10_11:23:51.455249) 11:23:54.958797 run osmo-hlr_10.42.42.2(pid=1831): stderr: | 20221210112351658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112351658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112351658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112351659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112351659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112351659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112351673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112351681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112351681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112351681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:55.010652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1830): Terminating (SIGTERM) 11:23:55.052393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1833): Terminating (SIGTERM) 11:23:55.094268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1836): Terminating (SIGTERM) 11:23:55.136450 --- ParallelTerminationStrategy: PID 1830 died... 11:23:55.156491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1830): Terminated: ok {rc=0} 11:23:55.202728 --- ParallelTerminationStrategy: PID 1833 died... 11:23:55.222363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1833): Terminated: ok {rc=0} 11:23:55.268130 --- ParallelTerminationStrategy: PID 1836 died... 11:23:55.287742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1836): Terminated: ok {rc=0} 11:23:55.375033 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:23:56.463378 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:56.476043 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:23:56.534948 tst ping_idle_ping.py: using LAC 28052 11:23:56.669575 tst ping_idle_ping.py: using RAC 2 11:23:56.796374 tst ping_idle_ping.py: using CellId 28052 11:23:56.922346 tst ping_idle_ping.py: using BVCI 28053 11:23:57.042310 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:57.053953 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:57.065341 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:57.076581 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:57.087787 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:57.099065 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:57.110512 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:23:57.121846 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:23:57.238144 tst ping_idle_ping.py:24: start network... 11:23:57.444535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:57.922635 run create_hlr_db(pid=1838): Launched 11:23:58.039741 bus /gobi_6: Setting Powered False 11:23:59.100159 run create_hlr_db(pid=1838): Terminated: ok {rc=0} 11:23:59.549627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1840): Launched 11:23:59.878086 run osmo-hlr_10.42.42.2(pid=1841): Launched 11:24:00.005586 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:00.568204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1843): Launched 11:24:00.913678 run osmo-stp_10.42.42.5(pid=1844): Launched 11:24:01.096877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:01.779429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1846): Launched 11:24:01.914237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:02.199334 run patchelf(pid=1847): Launched 11:24:02.390624 run osmo-stp_10.42.42.5(pid=1844): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1844)] 11:24:02.527999 run osmo-stp_10.42.42.5(pid=1844): stdout: | (launched: 2022-12-10_11:24:00.842988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:02.667375 run osmo-stp_10.42.42.5(pid=1844): stderr: | 20221210112401169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112401169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112401176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112401176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112401181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112401181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112401181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:02.806728 run osmo-stp_10.42.42.5(pid=1844): stdout: | (launched: 2022-12-10_11:24:00.842988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:02.940574 run osmo-stp_10.42.42.5(pid=1844): stderr: | 20221210112401169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112401169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112401176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112401176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112401181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112401181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112401181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:03.098945 run patchelf(pid=1847): Terminating (SIGINT) 11:24:03.280345 run patchelf(pid=1847): Terminated: ok {rc=0} 11:24:03.411243 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1844): Process ended prematurely: osmo-stp_10.42.42.5(pid=1844) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1844)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:24:03.420801 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:24:03.449008 run osmo-hlr_10.42.42.2(pid=1841): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1841)] 11:24:03.499256 run osmo-hlr_10.42.42.2(pid=1841): stdout: | (launched: 2022-12-10_11:23:59.816360) 11:24:03.551276 run osmo-hlr_10.42.42.2(pid=1841): stderr: | 20221210112400018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112400018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112400018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112400018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112400018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112400018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112400032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112400040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112400040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112400040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:03.603506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1840): Terminating (SIGTERM) 11:24:03.645571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1843): Terminating (SIGTERM) 11:24:03.687915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1846): Terminating (SIGTERM) 11:24:03.730516 --- ParallelTerminationStrategy: PID 1840 died... 11:24:03.750755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1840): Terminated: ok {rc=0} 11:24:03.797703 --- ParallelTerminationStrategy: PID 1843 died... 11:24:03.817540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1843): Terminated: ok {rc=0} 11:24:03.864114 --- ParallelTerminationStrategy: PID 1846 died... 11:24:03.884322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1846): Terminated: ok {rc=0} 11:24:03.973151 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:24:05.264011 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:05.270579 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:24:05.291847 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:24:05.331133 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:24:05.420030 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:24:05.441225 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:24:05.480423 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:24:06.076368 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:24:06.129683 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.140778 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:24:06.198819 tst cs_paging_gprs_active.py: using LAC 28053 11:24:06.327867 tst cs_paging_gprs_active.py: using RAC 3 11:24:06.457434 tst cs_paging_gprs_active.py: using CellId 28053 11:24:06.587373 tst cs_paging_gprs_active.py: using BVCI 28054 11:24:06.709396 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.720620 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.731712 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.742906 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.753912 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.764923 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.776107 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.787102 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:06.798337 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:06.916642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:07.034068 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:24:07.243416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:07.556171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1853): Launched 11:24:07.827383 run iperf3-srv_10.42.42.10(pid=1854): Launched 11:24:07.943204 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:24:08.151623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:08.464127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1855): Launched 11:24:08.735302 run iperf3-srv_10.42.42.10(pid=1856): Launched 11:24:08.851343 tst cs_paging_gprs_active.py:38: start network... 11:24:09.059431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:09.541564 run create_hlr_db(pid=1857): Launched 11:24:09.677597 bus /gobi_6: Setting Powered False 11:24:10.743454 run create_hlr_db(pid=1857): Terminated: ok {rc=0} 11:24:11.187106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1859): Launched 11:24:11.499537 run osmo-hlr_10.42.42.2(pid=1860): Launched 11:24:11.618322 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:12.165880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1862): Launched 11:24:12.478248 run osmo-stp_10.42.42.5(pid=1863): Launched 11:24:12.597352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:13.133644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1865): Launched 11:24:13.252315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:13.515801 run patchelf(pid=1866): Launched 11:24:13.688406 run osmo-stp_10.42.42.5(pid=1863): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1863)] 11:24:13.819507 run osmo-stp_10.42.42.5(pid=1863): stdout: | (launched: 2022-12-10_11:24:12.419264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:13.952164 run osmo-stp_10.42.42.5(pid=1863): stderr: | 20221210112412593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112412593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112412594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112412594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112412595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112412595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112412595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:14.085322 run osmo-stp_10.42.42.5(pid=1863): stdout: | (launched: 2022-12-10_11:24:12.419264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:14.211775 run osmo-stp_10.42.42.5(pid=1863): stderr: | 20221210112412593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112412593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112412594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112412594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112412595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112412595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112412595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:14.361972 run patchelf(pid=1866): Terminating (SIGINT) 11:24:14.535765 run patchelf(pid=1866): Terminated: ok {rc=0} 11:24:14.661980 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1863): Process ended prematurely: osmo-stp_10.42.42.5(pid=1863) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1863)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:24:14.671575 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:24:14.699248 run osmo-hlr_10.42.42.2(pid=1860): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1860)] 11:24:14.747202 run osmo-hlr_10.42.42.2(pid=1860): stdout: | (launched: 2022-12-10_11:24:11.440611) 11:24:14.797143 run osmo-hlr_10.42.42.2(pid=1860): stderr: | 20221210112411622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112411622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112411622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112411622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112411622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112411622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112411634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112411642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112411643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112411643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:14.847267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1853): Terminating (SIGTERM) 11:24:14.887307 run iperf3-srv_10.42.42.10(pid=1854): Terminating (SIGTERM) 11:24:14.927260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1855): Terminating (SIGTERM) 11:24:14.967408 run iperf3-srv_10.42.42.10(pid=1856): Terminating (SIGTERM) 11:24:15.007256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1859): Terminating (SIGTERM) 11:24:15.047171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1862): Terminating (SIGTERM) 11:24:15.087303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1865): Terminating (SIGTERM) 11:24:15.127441 --- ParallelTerminationStrategy: PID 1853 died... 11:24:15.146466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1853): Terminated: ok {rc=0} 11:24:15.190654 --- ParallelTerminationStrategy: PID 1854 died... 11:24:15.209260 run iperf3-srv_10.42.42.10(pid=1854): Terminated {rc=256} 11:24:15.253286 --- ParallelTerminationStrategy: PID 1855 died... 11:24:15.271799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1855): Terminated: ok {rc=0} 11:24:15.315941 --- ParallelTerminationStrategy: PID 1856 died... 11:24:15.334425 run iperf3-srv_10.42.42.10(pid=1856): Terminated {rc=256} 11:24:15.378634 --- ParallelTerminationStrategy: PID 1859 died... 11:24:15.397036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1859): Terminated: ok {rc=0} 11:24:15.441175 --- ParallelTerminationStrategy: PID 1862 died... 11:24:15.459663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1862): Terminated: ok {rc=0} 11:24:15.503815 --- ParallelTerminationStrategy: PID 1865 died... 11:24:15.522358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1865): Terminated: ok {rc=0} 11:24:15.607434 bus /gobi_0: Setting Powered False 11:24:16.734712 bus /gobi_0: Setting Powered False 11:24:17.862886 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:24:19.010800 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.022352 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:24:19.082043 tst iperf3.py: using LAC 28054 11:24:19.203694 tst iperf3.py: using RAC 4 11:24:19.325220 tst iperf3.py: using CellId 28054 11:24:19.446363 tst iperf3.py: using BVCI 28055 11:24:19.560190 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.571129 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.581907 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.592771 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.603734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.614599 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.625869 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.636642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:19.647674 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:19.766924 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:24:19.992911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:20.327684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1915): Launched 11:24:20.618601 run iperf3-srv_10.42.42.10(pid=1916): Launched 11:24:20.744852 tst iperf3.py:8: start network... 11:24:20.969389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:21.484152 run create_hlr_db(pid=1917): Launched 11:24:21.618301 bus /gobi_6: Setting Powered False 11:24:22.683795 run create_hlr_db(pid=1917): Terminated: ok {rc=0} 11:24:23.142494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1919): Launched 11:24:23.476667 run osmo-hlr_10.42.42.2(pid=1920): Launched 11:24:23.601864 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:24.178494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1922): Launched 11:24:24.513232 run osmo-stp_10.42.42.5(pid=1923): Launched 11:24:24.638555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:25.213419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1925): Launched 11:24:25.339331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:25.621542 run patchelf(pid=1926): Launched 11:24:25.804888 run osmo-stp_10.42.42.5(pid=1923): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1923)] 11:24:25.944177 run osmo-stp_10.42.42.5(pid=1923): stdout: | (launched: 2022-12-10_11:24:24.450875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:26.084821 run osmo-stp_10.42.42.5(pid=1923): stderr: | 20221210112424646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112424646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112424646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112424647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112424647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112424648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112424648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:26.226397 run osmo-stp_10.42.42.5(pid=1923): stdout: | (launched: 2022-12-10_11:24:24.450875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:26.361351 run osmo-stp_10.42.42.5(pid=1923): stderr: | 20221210112424646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112424646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112424646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112424647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112424647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112424648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112424648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:26.521872 run patchelf(pid=1926): Terminating (SIGINT) 11:24:26.707041 run patchelf(pid=1926): Terminated: ok {rc=0} 11:24:26.840514 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1923): Process ended prematurely: osmo-stp_10.42.42.5(pid=1923) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1923)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 11:24:26.850736 tst iperf3.py:8: Test FAILED (7.9 sec) 11:24:26.879121 run osmo-hlr_10.42.42.2(pid=1920): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1920)] 11:24:26.929179 run osmo-hlr_10.42.42.2(pid=1920): stdout: | (launched: 2022-12-10_11:24:23.414568) 11:24:26.981172 run osmo-hlr_10.42.42.2(pid=1920): stderr: | 20221210112423616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112423616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112423616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112423616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112423617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112423617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112423629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112423637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112423637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112423637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:27.033381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1915): Terminating (SIGTERM) 11:24:27.075182 run iperf3-srv_10.42.42.10(pid=1916): Terminating (SIGTERM) 11:24:27.116625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1919): Terminating (SIGTERM) 11:24:27.158190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1922): Terminating (SIGTERM) 11:24:27.199926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1925): Terminating (SIGTERM) 11:24:27.242216 --- ParallelTerminationStrategy: PID 1915 died... 11:24:27.262186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1915): Terminated: ok {rc=0} 11:24:27.309411 --- ParallelTerminationStrategy: PID 1916 died... 11:24:27.330109 run iperf3-srv_10.42.42.10(pid=1916): Terminated {rc=256} 11:24:27.375861 --- ParallelTerminationStrategy: PID 1919 died... 11:24:27.395323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1919): Terminated: ok {rc=0} 11:24:27.441297 --- ParallelTerminationStrategy: PID 1922 died... 11:24:27.460737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1922): Terminated: ok {rc=0} 11:24:27.507080 --- ParallelTerminationStrategy: PID 1925 died... 11:24:27.526739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1925): Terminated: ok {rc=0} 11:24:27.615421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:24:28.768198 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:28.780461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:24:28.839828 tst iperf3m4.py: using LAC 28055 11:24:28.970460 tst iperf3m4.py: using RAC 5 11:24:29.099817 tst iperf3m4.py: using CellId 28055 11:24:29.228548 tst iperf3m4.py: using BVCI 28056 11:24:29.348412 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.359885 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.371121 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.382499 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.393682 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.404846 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.416140 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.427347 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:29.438712 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:29.557596 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:29.681365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:29.801946 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:29.921825 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:24:30.146873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:30.481316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1928): Launched 11:24:30.772379 run iperf3-srv_10.42.42.10(pid=1931): Launched 11:24:30.898606 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:24:31.126881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:31.468518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1932): Launched 11:24:31.774499 run iperf3-srv_10.42.42.10(pid=1933): Launched 11:24:31.906155 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:24:32.134181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:32.470765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1934): Launched 11:24:32.760412 run iperf3-srv_10.42.42.10(pid=1935): Launched 11:24:32.886765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:24:33.111159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:33.446507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1936): Launched 11:24:33.735603 run iperf3-srv_10.42.42.10(pid=1937): Launched 11:24:33.859125 tst iperf3m4.py:8: start network... 11:24:34.082909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:34.598739 run create_hlr_db(pid=1938): Launched 11:24:34.732440 bus /gobi_6: Setting Powered False 11:24:35.798482 run create_hlr_db(pid=1938): Terminated: ok {rc=0} 11:24:36.262170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1940): Launched 11:24:36.595486 run osmo-hlr_10.42.42.2(pid=1941): Launched 11:24:36.722107 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:37.298716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1943): Launched 11:24:37.633936 run osmo-stp_10.42.42.5(pid=1944): Launched 11:24:37.760369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:38.340801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1947): Launched 11:24:38.467401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:38.751008 run patchelf(pid=1948): Launched 11:24:38.936469 run osmo-stp_10.42.42.5(pid=1944): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1944)] 11:24:39.076823 run osmo-stp_10.42.42.5(pid=1944): stdout: | (launched: 2022-12-10_11:24:37.571407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:39.220001 run osmo-stp_10.42.42.5(pid=1944): stderr: | 20221210112437768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112437768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112437768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112437768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112437771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112437771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112437771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:39.362041 run osmo-stp_10.42.42.5(pid=1944): stdout: | (launched: 2022-12-10_11:24:37.571407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:39.497968 run osmo-stp_10.42.42.5(pid=1944): stderr: | 20221210112437768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112437768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112437768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112437768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112437771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112437771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112437771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:39.659603 run patchelf(pid=1948): Terminating (SIGINT) 11:24:39.845223 run patchelf(pid=1948): Terminated: ok {rc=0} 11:24:39.979191 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1944): Process ended prematurely: osmo-stp_10.42.42.5(pid=1944) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1944)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:24:39.989413 tst iperf3m4.py:8: Test FAILED (11.3 sec) 11:24:40.018542 run osmo-hlr_10.42.42.2(pid=1941): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1941)] 11:24:40.069272 run osmo-hlr_10.42.42.2(pid=1941): stdout: | (launched: 2022-12-10_11:24:36.532741) 11:24:40.121616 run osmo-hlr_10.42.42.2(pid=1941): stderr: | 20221210112436735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112436735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112436735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112436735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112436735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112436735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112436758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112436768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112436768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112436768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:40.174483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1928): Terminating (SIGTERM) 11:24:40.216643 run iperf3-srv_10.42.42.10(pid=1931): Terminating (SIGTERM) 11:24:40.258992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1932): Terminating (SIGTERM) 11:24:40.301536 run iperf3-srv_10.42.42.10(pid=1933): Terminating (SIGTERM) 11:24:40.343631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1934): Terminating (SIGTERM) 11:24:40.385932 run iperf3-srv_10.42.42.10(pid=1935): Terminating (SIGTERM) 11:24:40.427974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1936): Terminating (SIGTERM) 11:24:40.470321 run iperf3-srv_10.42.42.10(pid=1937): Terminating (SIGTERM) 11:24:40.512310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1940): Terminating (SIGTERM) 11:24:40.554716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1943): Terminating (SIGTERM) 11:24:40.596821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1947): Terminating (SIGTERM) 11:24:40.639476 --- ParallelTerminationStrategy: PID 1928 died... 11:24:40.659676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1928): Terminated: ok {rc=0} 11:24:40.706550 --- ParallelTerminationStrategy: PID 1931 died... 11:24:40.726205 run iperf3-srv_10.42.42.10(pid=1931): Terminated {rc=256} 11:24:40.772686 --- ParallelTerminationStrategy: PID 1932 died... 11:24:40.792551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1932): Terminated: ok {rc=0} 11:24:40.839608 --- ParallelTerminationStrategy: PID 1933 died... 11:24:40.859338 run iperf3-srv_10.42.42.10(pid=1933): Terminated {rc=256} 11:24:40.906175 --- ParallelTerminationStrategy: PID 1934 died... 11:24:40.925896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1934): Terminated: ok {rc=0} 11:24:40.972700 --- ParallelTerminationStrategy: PID 1935 died... 11:24:40.992500 run iperf3-srv_10.42.42.10(pid=1935): Terminated {rc=256} 11:24:41.038965 --- ParallelTerminationStrategy: PID 1936 died... 11:24:41.058683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1936): Terminated: ok {rc=0} 11:24:41.105310 --- ParallelTerminationStrategy: PID 1937 died... 11:24:41.125113 run iperf3-srv_10.42.42.10(pid=1937): Terminated {rc=256} 11:24:41.171705 --- ParallelTerminationStrategy: PID 1940 died... 11:24:41.191638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1940): Terminated: ok {rc=0} 11:24:41.238071 --- ParallelTerminationStrategy: PID 1943 died... 11:24:41.257882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1943): Terminated: ok {rc=0} 11:24:41.304272 --- ParallelTerminationStrategy: PID 1947 died... 11:24:41.324146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1947): Terminated: ok {rc=0} 11:24:41.412428 bus /gobi_4: Setting Powered False 11:24:42.513473 bus /gobi_4: Setting Powered False 11:24:43.630474 bus /gobi_1: Setting Powered False 11:24:44.730773 bus /gobi_1: Setting Powered False 11:24:45.862642 bus /gobi_0: Setting Powered False 11:24:46.984187 bus /gobi_0: Setting Powered False 11:24:48.107186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:24:49.211827 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.223562 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:24:49.281623 tst ping.py: using LAC 28056 11:24:49.411212 tst ping.py: using RAC 6 11:24:49.541884 tst ping.py: using CellId 28056 11:24:49.669069 tst ping.py: using BVCI 28057 11:24:49.786716 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.798394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.809705 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.820776 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.831893 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.843134 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.854436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:49.865604 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:49.979249 tst ping.py:19: start network... 11:24:50.184581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:50.660766 run create_hlr_db(pid=1949): Launched 11:24:50.778426 bus /gobi_6: Setting Powered False 11:24:51.839117 run create_hlr_db(pid=1949): Terminated: ok {rc=0} 11:24:52.267428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Launched 11:24:52.575659 run osmo-hlr_10.42.42.2(pid=1952): Launched 11:24:52.692141 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:53.234458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Launched 11:24:53.541153 run osmo-stp_10.42.42.5(pid=1955): Launched 11:24:53.657707 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:54.185202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Launched 11:24:54.301352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:54.560847 run patchelf(pid=1958): Launched 11:24:54.730110 run osmo-stp_10.42.42.5(pid=1955): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] 11:24:54.859130 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-10_11:24:53.483132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:54.990987 run osmo-stp_10.42.42.5(pid=1955): stderr: | 20221210112453657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112453657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112453657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112453658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112453658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112453658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112453658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:55.121778 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-10_11:24:53.483132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:55.246721 run osmo-stp_10.42.42.5(pid=1955): stderr: | 20221210112453657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112453657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112453657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112453658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112453658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112453658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112453658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:55.394991 run patchelf(pid=1958): Terminating (SIGINT) 11:24:55.566325 run patchelf(pid=1958): Terminated: ok {rc=0} 11:24:55.689358 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1955): Process ended prematurely: osmo-stp_10.42.42.5(pid=1955) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 11:24:55.698539 tst ping.py:22: Test FAILED (6.5 sec) 11:24:55.725915 run osmo-hlr_10.42.42.2(pid=1952): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1952)] 11:24:55.775143 run osmo-hlr_10.42.42.2(pid=1952): stdout: | (launched: 2022-12-10_11:24:52.517203) 11:24:55.826217 run osmo-hlr_10.42.42.2(pid=1952): stderr: | 20221210112452698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112452698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112452698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112452698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112452698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112452698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112452710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112452720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112452721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112452721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:55.877114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminating (SIGTERM) 11:24:55.917924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminating (SIGTERM) 11:24:55.958555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Terminating (SIGTERM) 11:24:55.999576 --- ParallelTerminationStrategy: PID 1951 died... 11:24:56.019040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminated: ok {rc=0} 11:24:56.064749 --- ParallelTerminationStrategy: PID 1954 died... 11:24:56.083477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminated: ok {rc=0} 11:24:56.128440 --- ParallelTerminationStrategy: PID 1957 died... 11:24:56.147359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Terminated: ok {rc=0} 11:24:56.235293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:24:57.324662 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.336815 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:24:57.395193 tst ping_idle_ping.py: using LAC 28057 11:24:57.516341 tst ping_idle_ping.py: using RAC 7 11:24:57.637370 tst ping_idle_ping.py: using CellId 28057 11:24:57.756617 tst ping_idle_ping.py: using BVCI 28058 11:24:57.866920 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.877995 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.888632 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.899625 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.910588 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.921623 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.932695 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:24:57.943742 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:24:58.063413 tst ping_idle_ping.py:24: start network... 11:24:58.285500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:58.798337 run create_hlr_db(pid=1959): Launched 11:24:58.931994 bus /gobi_6: Setting Powered False 11:24:59.997461 run create_hlr_db(pid=1959): Terminated: ok {rc=0} 11:25:00.436411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Launched 11:25:00.747131 run osmo-hlr_10.42.42.2(pid=1962): Launched 11:25:00.865395 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:01.580451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Launched 11:25:01.942293 run osmo-stp_10.42.42.5(pid=1969): Launched 11:25:02.101967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:02.814607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1971): Launched 11:25:02.939330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:03.219534 run patchelf(pid=1972): Launched 11:25:03.400557 run osmo-stp_10.42.42.5(pid=1969): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1969)] 11:25:03.538432 run osmo-stp_10.42.42.5(pid=1969): stdout: | (launched: 2022-12-10_11:25:01.881199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:03.678500 run osmo-stp_10.42.42.5(pid=1969): stderr: | 20221210112502217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112502218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112502218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112502219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112502221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112502222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112502222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:03.818796 run osmo-stp_10.42.42.5(pid=1969): stdout: | (launched: 2022-12-10_11:25:01.881199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:03.953442 run osmo-stp_10.42.42.5(pid=1969): stderr: | 20221210112502217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112502218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112502218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112502219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112502221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112502222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112502222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:04.112414 run patchelf(pid=1972): Terminating (SIGINT) 11:25:04.295562 run patchelf(pid=1972): Terminated: ok {rc=0} 11:25:04.427468 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1969): Process ended prematurely: osmo-stp_10.42.42.5(pid=1969) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1969)] [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:25:04.437075 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 11:25:04.465369 run osmo-hlr_10.42.42.2(pid=1962): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1962)] 11:25:04.515892 run osmo-hlr_10.42.42.2(pid=1962): stdout: | (launched: 2022-12-10_11:25:00.687828) 11:25:04.568385 run osmo-hlr_10.42.42.2(pid=1962): stderr: | 20221210112500955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112500955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112500955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112500955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112500955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112500956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112500972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112500993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112500993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112500993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:04.621553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminating (SIGTERM) 11:25:04.663683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminating (SIGTERM) 11:25:04.705867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1971): Terminating (SIGTERM) 11:25:04.748330 --- ParallelTerminationStrategy: PID 1961 died... 11:25:04.768517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminated: ok {rc=0} 11:25:04.815116 --- ParallelTerminationStrategy: PID 1965 died... 11:25:04.834860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminated: ok {rc=0} 11:25:04.881401 --- ParallelTerminationStrategy: PID 1971 died... 11:25:04.901185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1971): Terminated: ok {rc=0} 11:25:04.990487 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:25:06.283669 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:06.291150 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:25:06.312684 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:25:06.347924 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:25:06.402405 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:25:06.423587 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:25:06.458901 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:25:07.021963 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:25:07.028504 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.041629 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:25:07.097927 tst switch_tch_pdch.py: using LAC 28058 11:25:07.218963 tst switch_tch_pdch.py: using RAC 8 11:25:07.336746 tst switch_tch_pdch.py: using CellId 28058 11:25:07.454655 tst switch_tch_pdch.py: using BVCI 28059 11:25:07.565417 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.577143 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.588434 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.600054 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.611537 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.623094 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.634839 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:25:07.646388 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:25:07.765869 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:25:07.886101 tst switch_tch_pdch.py:51: start network... 11:25:08.106772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:08.613485 run create_hlr_db(pid=1976): Launched 11:25:08.745277 bus /gobi_6: Setting Powered False 11:25:09.809868 run create_hlr_db(pid=1976): Terminated: ok {rc=0} 11:25:10.247188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1978): Launched 11:25:10.553845 run osmo-hlr_10.42.42.2(pid=1979): Launched 11:25:10.670302 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:11.208086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1981): Launched 11:25:11.514692 run osmo-stp_10.42.42.5(pid=1982): Launched 11:25:11.632082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:12.160174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1984): Launched 11:25:12.286632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:12.563962 run patchelf(pid=1985): Launched 11:25:12.744058 run osmo-stp_10.42.42.5(pid=1982): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1982)] 11:25:12.881619 run osmo-stp_10.42.42.5(pid=1982): stdout: | (launched: 2022-12-10_11:25:11.456478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:13.021614 run osmo-stp_10.42.42.5(pid=1982): stderr: | 20221210112511629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112511630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112511630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112511630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112511631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112511631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112511631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:13.161600 run osmo-stp_10.42.42.5(pid=1982): stdout: | (launched: 2022-12-10_11:25:11.456478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:13.294998 run osmo-stp_10.42.42.5(pid=1982): stderr: | 20221210112511629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112511630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112511630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112511630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112511631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112511631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112511631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:13.453758 run patchelf(pid=1985): Terminating (SIGINT) 11:25:13.636404 run patchelf(pid=1985): Terminated: ok {rc=0} 11:25:13.767894 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1982): Process ended prematurely: osmo-stp_10.42.42.5(pid=1982) [trial-2374↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1982)] [trial-2374↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:25:13.777384 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:25:13.805357 run osmo-hlr_10.42.42.2(pid=1979): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1979)] 11:25:13.855650 run osmo-hlr_10.42.42.2(pid=1979): stdout: | (launched: 2022-12-10_11:25:10.495978) 11:25:13.907621 run osmo-hlr_10.42.42.2(pid=1979): stderr: | 20221210112510677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112510677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112510677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112510677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112510677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112510677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112510694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112510704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112510704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112510704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:13.960100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1978): Terminating (SIGTERM) 11:25:14.002211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1981): Terminating (SIGTERM) 11:25:14.044133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1984): Terminating (SIGTERM) 11:25:14.086305 --- ParallelTerminationStrategy: PID 1978 died... 11:25:14.106605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1978): Terminated: ok {rc=0} 11:25:14.153540 --- ParallelTerminationStrategy: PID 1981 died... 11:25:14.173474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1981): Terminated: ok {rc=0} 11:25:14.219938 --- ParallelTerminationStrategy: PID 1984 died... 11:25:14.239600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1984): Terminated: ok {rc=0} 11:25:14.327680 bus /gobi_0: Setting Powered False 11:25:15.427219 bus /gobi_0: Setting Powered False 11:25:16.541942 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:25:17.779824 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:17.786890 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:25:17.808584 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:25:17.843322 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:25:17.900860 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:25:17.922880 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:25:17.958578 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:25:18.506089 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:25:18.511089 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:18.522170 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:25:18.576825 tst switch_tch_pdch.py: using LAC 28059 11:25:18.695913 tst switch_tch_pdch.py: using RAC 9 11:25:18.813299 tst switch_tch_pdch.py: using CellId 28059 11:25:18.931139 tst switch_tch_pdch.py: using BVCI 28060 11:25:19.041411 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:19.052328 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:19.063102 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:19.074090 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:19.084991 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:19.095823 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:19.106950 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:25:19.118180 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:25:19.237268 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:25:19.352573 tst switch_tch_pdch.py:51: start network... 11:25:19.559102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:20.009679 run create_hlr_db(pid=1989): Launched 11:25:20.126663 bus /gobi_6: Setting Powered False 11:25:21.188140 run create_hlr_db(pid=1989): Terminated: ok {rc=0} 11:25:21.609833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Launched 11:25:21.938869 run osmo-hlr_10.42.42.2(pid=1992): Launched 11:25:22.063653 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:22.604144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Launched 11:25:22.932939 run osmo-stp_10.42.42.5(pid=1995): Launched 11:25:23.058773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:23.597340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1997): Launched 11:25:23.723207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:24.001271 run patchelf(pid=1998): Launched 11:25:24.182538 run osmo-stp_10.42.42.5(pid=1995): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] 11:25:24.320262 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-10_11:25:22.871057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:24.459942 run osmo-stp_10.42.42.5(pid=1995): stderr: | 20221210112523066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112523066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112523066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112523066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112523069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112523069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112523069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:24.599638 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-10_11:25:22.871057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:24.733322 run osmo-stp_10.42.42.5(pid=1995): stderr: | 20221210112523066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112523066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112523066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112523066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112523069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112523069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112523069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:24.891970 run patchelf(pid=1998): Terminating (SIGINT) 11:25:25.075092 run patchelf(pid=1998): Terminated: ok {rc=0} 11:25:25.207399 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2374↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] [trial-2374↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:25:25.217096 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:25:25.245282 run osmo-hlr_10.42.42.2(pid=1992): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1992)] 11:25:25.295661 run osmo-hlr_10.42.42.2(pid=1992): stdout: | (launched: 2022-12-10_11:25:21.876575) 11:25:25.348074 run osmo-hlr_10.42.42.2(pid=1992): stderr: | 20221210112522077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112522078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112522078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112522078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112522078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112522078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112522090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112522098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112522099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112522099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:25.400418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminating (SIGTERM) 11:25:25.442595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminating (SIGTERM) 11:25:25.484724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1997): Terminating (SIGTERM) 11:25:25.527771 --- ParallelTerminationStrategy: PID 1991 died... 11:25:25.548010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminated: ok {rc=0} 11:25:25.595015 --- ParallelTerminationStrategy: PID 1994 died... 11:25:25.614880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminated: ok {rc=0} 11:25:25.661500 --- ParallelTerminationStrategy: PID 1997 died... 11:25:25.681377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1997): Terminated: ok {rc=0} 11:25:25.770299 bus /gobi_0: Setting Powered False 11:25:26.870683 bus /gobi_0: Setting Powered False 11:25:27.991402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_sms:oc2g --------------------------------------------------------------------- 11:25:29.234178 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:29.238340 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 11:25:29.259474 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 11:25:29.266743 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 11:25:29.319285 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 11:25:29.340380 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 11:25:29.347332 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 11:25:29.883248 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:25:29.889358 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 11:25:29.900440 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 11:25:29.940391 tst mo_mt_sms.py: using LAC 28060 11:25:30.060599 tst mo_mt_sms.py: using RAC 10 11:25:30.179451 tst mo_mt_sms.py: using CellId 28060 11:25:30.298258 tst mo_mt_sms.py: using BVCI 28061 11:25:30.410815 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:25:30.524504 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:25:30.644434 tst mo_mt_sms.py:9: start nitb and bts... 11:25:30.852008 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:25:31.497958 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2003): Launched 11:25:31.825907 run osmo-nitb_10.42.42.2(pid=2004): Launched 11:25:32.019175 run osmo-nitb_10.42.42.2(pid=2004): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2004)] 11:25:32.159607 run osmo-nitb_10.42.42.2(pid=2004): stdout: | (launched: 2022-12-10_11:25:31.765082) 11:25:32.299845 run osmo-nitb_10.42.42.2(pid=2004): stderr: | (launched: 2022-12-10_11:25:31.811153) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:25:32.438438 run osmo-nitb_10.42.42.2(pid=2004): stdout: | (launched: 2022-12-10_11:25:31.765082) 11:25:32.571296 run osmo-nitb_10.42.42.2(pid=2004): stderr: | (launched: 2022-12-10_11:25:31.811153) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2004): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2004) [trial-2374↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2004)] 11:25:32.964280 tst osmo-nitb_10.42.42.2(pid=2004): stdout: | (launched: 2022-12-10_11:25:31.765082) 11:25:33.087236 tst osmo-nitb_10.42.42.2(pid=2004): stderr: | (launched: 2022-12-10_11:25:31.811153) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:25:33.232059 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2004): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2004) [trial-2374↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2004)] [trial-2374↪nitb_sms:oc2g↪mo_mt_sms.py:11] 11:25:33.240481 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:25:33.247054 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2003): Terminating (SIGTERM) 11:25:33.456303 --- ParallelTerminationStrategy: PID 2003 died... 11:25:33.476707 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2003): Terminated: ok {rc=0} 11:25:33.563305 bus /sierra_3: Setting Powered False 11:25:34.663395 bus /sierra_3: Setting Powered False 11:25:35.777971 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:oc2g --------------------------------------------------------------------- 11:25:36.960486 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:36.964838 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 11:25:36.986538 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 11:25:37.014602 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 11:25:37.067837 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 11:25:37.089192 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 11:25:37.116779 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 11:25:37.658576 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:25:37.664350 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:25:37.675284 tst sms:oc2g: Using 1 x bts (candidates: 1) 11:25:37.710086 tst mo_mt_sms.py: using LAC 28061 11:25:37.831751 tst mo_mt_sms.py: using RAC 11 11:25:37.951753 tst mo_mt_sms.py: using CellId 28061 11:25:38.071854 tst mo_mt_sms.py: using BVCI 28062 11:25:38.183320 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:25:38.193905 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:25:38.204233 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:25:38.214802 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:25:38.225474 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:25:38.235935 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:25:38.349570 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:25:38.469242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:38.978435 run create_hlr_db(pid=2008): Launched 11:25:39.112487 bus /sierra_2: Setting Powered False 11:25:40.177904 run create_hlr_db(pid=2008): Terminated: ok {rc=0} 11:25:40.616646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2010): Launched 11:25:40.924089 run osmo-hlr_10.42.42.2(pid=2011): Launched 11:25:41.039993 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:41.571514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2013): Launched 11:25:41.878585 run osmo-stp_10.42.42.5(pid=2014): Launched 11:25:42.031301 run osmo-msc_10.42.42.6: Starting osmo-msc 11:25:42.585430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2016): Launched 11:25:42.892495 run osmo-msc_10.42.42.6(pid=2017): Launched 11:25:43.062890 run osmo-stp_10.42.42.5(pid=2014): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2014)] 11:25:43.191544 run osmo-stp_10.42.42.5(pid=2014): stdout: | (launched: 2022-12-10_11:25:41.820094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:43.320579 run osmo-stp_10.42.42.5(pid=2014): stderr: | 20221210112542029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112542029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112542030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112542030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112542032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112542032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112542032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:43.447304 run osmo-stp_10.42.42.5(pid=2014): stdout: | (launched: 2022-12-10_11:25:41.820094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:43.569159 run osmo-stp_10.42.42.5(pid=2014): stderr: | 20221210112542029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112542029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112542030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112542030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112542032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112542032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112542032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:43.714921 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2014): Process ended prematurely: osmo-stp_10.42.42.5(pid=2014) [trial-2374↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2014)] [trial-2374↪sms:oc2g↪mo_mt_sms.py:16] 11:25:43.723263 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 11:25:43.749808 run osmo-hlr_10.42.42.2(pid=2011): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2011)] 11:25:43.798054 run osmo-hlr_10.42.42.2(pid=2011): stdout: | (launched: 2022-12-10_11:25:40.866379) 11:25:43.848033 run osmo-hlr_10.42.42.2(pid=2011): stderr: | 20221210112541047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112541048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112541048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112541048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112541048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112541048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112541061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112541069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112541070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112541070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:43.917371 run osmo-msc_10.42.42.6(pid=2017): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2017)] 11:25:43.965358 run osmo-msc_10.42.42.6(pid=2017): stdout: | (launched: 2022-12-10_11:25:42.834358) 11:25:44.015101 run osmo-msc_10.42.42.6(pid=2017): stderr: | 20221210112543111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112543111 DLGLOBAL DEBUG validating counter group 0x7fea70f56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112543111 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112543111 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112543112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112543112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112543113 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112543114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112543114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112543114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:25:44.065052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2010): Terminating (SIGTERM) 11:25:44.105350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2013): Terminating (SIGTERM) 11:25:44.145643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2016): Terminating (SIGTERM) 11:25:44.186141 --- ParallelTerminationStrategy: PID 2010 died... 11:25:44.205300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2010): Terminated: ok {rc=0} 11:25:44.250111 --- ParallelTerminationStrategy: PID 2013 died... 11:25:44.268707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2013): Terminated: ok {rc=0} 11:25:44.313492 --- ParallelTerminationStrategy: PID 2016 died... 11:25:44.332253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2016): Terminated: ok {rc=0} 11:25:44.419248 bus /sierra_3: Setting Powered False 11:25:45.518194 bus /sierra_3: Setting Powered False 11:25:46.632016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:oc2g --------------------------------------------------------------------- 11:25:47.847522 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:47.851580 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:25:47.872564 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 11:25:47.879581 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:25:47.915136 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:25:47.937195 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 11:25:47.944363 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:25:48.463716 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 11:25:48.469065 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 11:25:48.480065 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 11:25:48.514279 tst assert_extension.py: using LAC 28062 11:25:48.641911 tst assert_extension.py: using RAC 12 11:25:48.767964 tst assert_extension.py: using CellId 28062 11:25:48.888386 tst assert_extension.py: using BVCI 28063 11:25:48.998727 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 11:25:49.115364 tst assert_extension.py:10: start nitb and bts... 11:25:49.336896 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:25:50.005226 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2022): Launched 11:25:50.333598 run osmo-nitb_10.42.42.2(pid=2023): Launched 11:25:50.514083 run osmo-nitb_10.42.42.2(pid=2023): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2023)] 11:25:50.659494 run osmo-nitb_10.42.42.2(pid=2023): stdout: | (launched: 2022-12-10_11:25:50.271333) 11:25:50.806821 run osmo-nitb_10.42.42.2(pid=2023): stderr: | (launched: 2022-12-10_11:25:50.319715) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:25:50.954020 run osmo-nitb_10.42.42.2(pid=2023): stdout: | (launched: 2022-12-10_11:25:50.271333) 11:25:51.095612 run osmo-nitb_10.42.42.2(pid=2023): stderr: | (launched: 2022-12-10_11:25:50.319715) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2023) [trial-2374↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2023)] 11:25:51.456654 tst osmo-nitb_10.42.42.2(pid=2023): stdout: | (launched: 2022-12-10_11:25:50.271333) 11:25:51.588584 tst osmo-nitb_10.42.42.2(pid=2023): stderr: | (launched: 2022-12-10_11:25:50.319715) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:25:51.744506 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2023) [trial-2374↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2023)] [trial-2374↪nitb_ussd:oc2g↪assert_extension.py:12] 11:25:51.753534 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:25:51.761218 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2022): Terminating (SIGTERM) 11:25:51.971894 --- ParallelTerminationStrategy: PID 2022 died... 11:25:51.994029 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2022): Terminated: ok {rc=0} 11:25:52.082955 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:oc2g --------------------------------------------------------------------- 11:25:53.245880 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:53.249795 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:25:53.270526 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 11:25:53.297106 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:25:53.334522 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:25:53.354931 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 11:25:53.381978 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:25:53.910488 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:oc2g assert_extension.py ---------------------------------------------- 11:25:53.915966 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:25:53.927112 tst ussd:oc2g: Using 1 x bts (candidates: 1) 11:25:53.961918 tst assert_extension.py: using LAC 28063 11:25:54.089703 tst assert_extension.py: using RAC 13 11:25:54.219139 tst assert_extension.py: using CellId 28063 11:25:54.349202 tst assert_extension.py: using BVCI 28064 11:25:54.461315 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:25:54.471878 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:25:54.482860 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:25:54.493514 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:25:54.504174 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:25:54.514951 tst ussd:oc2g: Using 1 x modem (candidates: 1) 11:25:54.633419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:55.143461 run create_hlr_db(pid=2027): Launched 11:25:55.276159 bus /sierra_2: Setting Powered False 11:25:56.341290 run create_hlr_db(pid=2027): Terminated: ok {rc=0} 11:25:56.778880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Launched 11:25:57.086836 run osmo-hlr_10.42.42.2(pid=2030): Launched 11:25:57.202993 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:57.761639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Launched 11:25:58.070001 run osmo-stp_10.42.42.5(pid=2033): Launched 11:25:58.185829 run osmo-msc_10.42.42.6: Starting osmo-msc 11:25:58.736070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2035): Launched 11:25:59.043889 run osmo-msc_10.42.42.6(pid=2036): Launched 11:25:59.214190 run osmo-stp_10.42.42.5(pid=2033): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] 11:25:59.343889 run osmo-stp_10.42.42.5(pid=2033): stdout: | (launched: 2022-12-10_11:25:58.011343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:59.473688 run osmo-stp_10.42.42.5(pid=2033): stderr: | 20221210112558186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112558186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112558186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112558187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112558187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112558187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112558187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:59.600862 run osmo-stp_10.42.42.5(pid=2033): stdout: | (launched: 2022-12-10_11:25:58.011343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:59.723012 run osmo-stp_10.42.42.5(pid=2033): stderr: | 20221210112558186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112558186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112558186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112558187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112558187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112558187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112558187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:59.869628 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2033): Process ended prematurely: osmo-stp_10.42.42.5(pid=2033) [trial-2374↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] [trial-2374↪ussd:oc2g↪assert_extension.py:17] 11:25:59.878404 tst assert_extension.py:17: Test FAILED (6.0 sec) 11:25:59.905125 run osmo-hlr_10.42.42.2(pid=2030): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2030)] 11:25:59.953132 run osmo-hlr_10.42.42.2(pid=2030): stdout: | (launched: 2022-12-10_11:25:57.028482) 11:26:00.002767 run osmo-hlr_10.42.42.2(pid=2030): stderr: | 20221210112557210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112557210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112557210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112557210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112557210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112557210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112557222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112557230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112557231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112557231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:00.071922 run osmo-msc_10.42.42.6(pid=2036): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2036)] 11:26:00.119975 run osmo-msc_10.42.42.6(pid=2036): stdout: | (launched: 2022-12-10_11:25:58.985703) 11:26:00.169568 run osmo-msc_10.42.42.6(pid=2036): stderr: | 20221210112559258 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112559259 DLGLOBAL DEBUG validating counter group 0x7f7e418a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112559259 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112559259 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112559259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112559259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112559262 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112559263 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112559263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112559263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:00.219990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Terminating (SIGTERM) 11:26:00.260044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Terminating (SIGTERM) 11:26:00.300040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2035): Terminating (SIGTERM) 11:26:00.340710 --- ParallelTerminationStrategy: PID 2029 died... 11:26:00.359945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Terminated: ok {rc=0} 11:26:00.405084 --- ParallelTerminationStrategy: PID 2032 died... 11:26:00.423763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Terminated: ok {rc=0} 11:26:00.468152 --- ParallelTerminationStrategy: PID 2035 died... 11:26:00.486958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2035): Terminated: ok {rc=0} 11:26:00.573760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:26:01.816570 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:01.823699 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:26:01.849644 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:26:01.878806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:26:01.933885 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:26:01.961717 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:26:01.995024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:26:02.532729 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:26:02.587192 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:02.598755 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:26:02.656849 tst mo_mt_call.py: using LAC 28064 11:26:02.788071 tst mo_mt_call.py: using RAC 14 11:26:02.915568 tst mo_mt_call.py: using CellId 28064 11:26:03.037675 tst mo_mt_call.py: using BVCI 28065 11:26:03.150477 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:03.161711 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:03.172732 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:03.184415 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:03.196176 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:03.207794 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:26:03.329588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:26:03.446576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:03.932044 run create_hlr_db(pid=2041): Launched 11:26:04.050184 bus /sierra_2: Setting Powered False 11:26:05.111807 run create_hlr_db(pid=2041): Terminated: ok {rc=0} 11:26:05.569960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2043): Launched 11:26:05.905524 run osmo-hlr_10.42.42.2(pid=2044): Launched 11:26:06.032163 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:06.608742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2046): Launched 11:26:06.944476 run osmo-stp_10.42.42.5(pid=2047): Launched 11:26:07.070627 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:07.672920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2049): Launched 11:26:08.007648 run osmo-msc_10.42.42.6(pid=2050): Launched 11:26:08.191356 run osmo-stp_10.42.42.5(pid=2047): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2047)] 11:26:08.331032 run osmo-stp_10.42.42.5(pid=2047): stdout: | (launched: 2022-12-10_11:26:06.881288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:08.470849 run osmo-stp_10.42.42.5(pid=2047): stderr: | 20221210112607080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112607080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112607080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112607081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112607081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112607081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112607081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:08.609769 run osmo-stp_10.42.42.5(pid=2047): stdout: | (launched: 2022-12-10_11:26:06.881288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:08.742332 run osmo-stp_10.42.42.5(pid=2047): stderr: | 20221210112607080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112607080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112607080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112607081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112607081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112607081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112607081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:08.900816 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2047): Process ended prematurely: osmo-stp_10.42.42.5(pid=2047) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2047)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:26:08.910544 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:26:08.938705 run osmo-hlr_10.42.42.2(pid=2044): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2044)] 11:26:08.989172 run osmo-hlr_10.42.42.2(pid=2044): stdout: | (launched: 2022-12-10_11:26:05.842784) 11:26:09.041265 run osmo-hlr_10.42.42.2(pid=2044): stderr: | 20221210112606046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112606046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112606046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112606046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112606046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112606046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112606059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112606067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112606067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112606067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:09.113519 run osmo-msc_10.42.42.6(pid=2050): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2050)] 11:26:09.163702 run osmo-msc_10.42.42.6(pid=2050): stdout: | (launched: 2022-12-10_11:26:07.944543) 11:26:09.215520 run osmo-msc_10.42.42.6(pid=2050): stderr: | 20221210112608271 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112608271 DLGLOBAL DEBUG validating counter group 0x7fb77fbb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112608271 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112608271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112608271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112608271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112608273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112608274 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112608274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112608274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:09.267643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2043): Terminating (SIGTERM) 11:26:09.309366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2046): Terminating (SIGTERM) 11:26:09.351672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2049): Terminating (SIGTERM) 11:26:09.394019 --- ParallelTerminationStrategy: PID 2043 died... 11:26:09.413702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2043): Terminated: ok {rc=0} 11:26:09.460309 --- ParallelTerminationStrategy: PID 2046 died... 11:26:09.480031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2046): Terminated: ok {rc=0} 11:26:09.526573 --- ParallelTerminationStrategy: PID 2049 died... 11:26:09.546487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2049): Terminated: ok {rc=0} 11:26:09.634898 bus /sierra_3: Setting Powered False 11:26:10.733748 bus /sierra_3: Setting Powered False 11:26:11.848047 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:26:13.002206 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:13.014439 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:26:13.073130 tst mo_mt_call_osmux.py: using LAC 28065 11:26:13.204212 tst mo_mt_call_osmux.py: using RAC 15 11:26:13.333754 tst mo_mt_call_osmux.py: using CellId 28065 11:26:13.465120 tst mo_mt_call_osmux.py: using BVCI 28066 11:26:13.586413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:13.597909 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:13.609282 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:13.620496 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:13.631765 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:26:13.643091 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:26:13.759534 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:26:13.876231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:14.363284 run create_hlr_db(pid=2052): Launched 11:26:14.482443 bus /sierra_2: Setting Powered False 11:26:15.543302 run create_hlr_db(pid=2052): Terminated: ok {rc=0} 11:26:16.021115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Launched 11:26:16.357648 run osmo-hlr_10.42.42.2(pid=2055): Launched 11:26:16.610551 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:17.263901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Launched 11:26:17.591645 run osmo-stp_10.42.42.5(pid=2058): Launched 11:26:17.711780 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:18.276002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2060): Launched 11:26:18.588409 run osmo-msc_10.42.42.6(pid=2061): Launched 11:26:18.761571 run osmo-stp_10.42.42.5(pid=2058): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] 11:26:18.892546 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-10_11:26:17.531966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:19.023204 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221210112617705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112617705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112617705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112617706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112617706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112617706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112617706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:19.152463 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-10_11:26:17.531966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:19.275982 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221210112617705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112617705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112617705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112617706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112617706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112617706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112617706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:19.424099 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2058): Process ended prematurely: osmo-stp_10.42.42.5(pid=2058) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:26:19.433202 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:26:19.460185 run osmo-hlr_10.42.42.2(pid=2055): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2055)] 11:26:19.508765 run osmo-hlr_10.42.42.2(pid=2055): stdout: | (launched: 2022-12-10_11:26:16.292658) 11:26:19.558811 run osmo-hlr_10.42.42.2(pid=2055): stderr: | 20221210112616510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112616510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112616510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112616510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112616510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112616510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112616529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112616540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112616540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112616540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:19.628365 run osmo-msc_10.42.42.6(pid=2061): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2061)] 11:26:19.676468 run osmo-msc_10.42.42.6(pid=2061): stdout: | (launched: 2022-12-10_11:26:18.529393) 11:26:19.726263 run osmo-msc_10.42.42.6(pid=2061): stderr: | 20221210112618803 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112618803 DLGLOBAL DEBUG validating counter group 0x7f6e3cf31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112618804 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112618804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112618804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112618804 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112618806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112618806 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112618806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112618806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:19.776494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminating (SIGTERM) 11:26:19.816430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminating (SIGTERM) 11:26:19.856406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2060): Terminating (SIGTERM) 11:26:19.896678 --- ParallelTerminationStrategy: PID 2054 died... 11:26:19.915752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminated: ok {rc=0} 11:26:19.960691 --- ParallelTerminationStrategy: PID 2057 died... 11:26:19.979458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminated: ok {rc=0} 11:26:20.024066 --- ParallelTerminationStrategy: PID 2060 died... 11:26:20.042822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2060): Terminated: ok {rc=0} 11:26:20.129892 bus /sierra_3: Setting Powered False 11:26:21.229592 bus /sierra_3: Setting Powered False 11:26:22.343472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:26:23.572107 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:23.578727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:26:23.600302 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:26:23.627831 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:26:23.679757 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:26:23.700145 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:26:23.726856 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:26:24.275782 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:26:24.325794 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:24.337390 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:26:24.393362 tst mo_mt_call.py: using LAC 28066 11:26:24.515991 tst mo_mt_call.py: using RAC 16 11:26:24.638940 tst mo_mt_call.py: using CellId 28066 11:26:24.761780 tst mo_mt_call.py: using BVCI 28067 11:26:24.874014 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:24.885079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:24.895959 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:24.906993 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:24.917981 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:24.929130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:26:25.050209 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:26:25.166134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:25.651099 run create_hlr_db(pid=2066): Launched 11:26:25.769863 bus /sierra_2: Setting Powered False 11:26:26.831953 run create_hlr_db(pid=2066): Terminated: ok {rc=0} 11:26:27.289349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2068): Launched 11:26:27.625162 run osmo-hlr_10.42.42.2(pid=2069): Launched 11:26:27.753071 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:28.331464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2071): Launched 11:26:28.665884 run osmo-stp_10.42.42.5(pid=2072): Launched 11:26:28.792159 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:29.394620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2074): Launched 11:26:29.729636 run osmo-msc_10.42.42.6(pid=2075): Launched 11:26:29.914098 run osmo-stp_10.42.42.5(pid=2072): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2072)] 11:26:30.053993 run osmo-stp_10.42.42.5(pid=2072): stdout: | (launched: 2022-12-10_11:26:28.603142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:30.194384 run osmo-stp_10.42.42.5(pid=2072): stderr: | 20221210112628801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112628801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112628801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112628802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112628802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112628802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112628802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:30.334034 run osmo-stp_10.42.42.5(pid=2072): stdout: | (launched: 2022-12-10_11:26:28.603142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:30.466651 run osmo-stp_10.42.42.5(pid=2072): stderr: | 20221210112628801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112628801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112628801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112628802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112628802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112628802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112628802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:30.625552 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2072): Process ended prematurely: osmo-stp_10.42.42.5(pid=2072) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2072)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:26:30.634965 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:26:30.662991 run osmo-hlr_10.42.42.2(pid=2069): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2069)] 11:26:30.713285 run osmo-hlr_10.42.42.2(pid=2069): stdout: | (launched: 2022-12-10_11:26:27.562786) 11:26:30.765362 run osmo-hlr_10.42.42.2(pid=2069): stderr: | 20221210112627766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112627766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112627766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112627766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112627766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112627766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112627779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112627787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112627787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112627787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:30.848349 run osmo-msc_10.42.42.6(pid=2075): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2075)] 11:26:30.906550 run osmo-msc_10.42.42.6(pid=2075): stdout: | (launched: 2022-12-10_11:26:29.666330) 11:26:30.964658 run osmo-msc_10.42.42.6(pid=2075): stderr: | 20221210112629992 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112629992 DLGLOBAL DEBUG validating counter group 0x7f9473e3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112629992 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112629992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112629992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112629993 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112629994 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112629995 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112629995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112629995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:31.018713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2068): Terminating (SIGTERM) 11:26:31.061888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2071): Terminating (SIGTERM) 11:26:31.106664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2074): Terminating (SIGTERM) 11:26:31.151911 --- ParallelTerminationStrategy: PID 2068 died... 11:26:31.173241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2068): Terminated: ok {rc=0} 11:26:31.222952 --- ParallelTerminationStrategy: PID 2071 died... 11:26:31.243082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2071): Terminated: ok {rc=0} 11:26:31.291112 --- ParallelTerminationStrategy: PID 2074 died... 11:26:31.311067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2074): Terminated: ok {rc=0} 11:26:31.402072 bus /sierra_3: Setting Powered False 11:26:32.501120 bus /sierra_3: Setting Powered False 11:26:33.618819 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:26:34.770812 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:34.782996 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:26:34.840849 tst mo_mt_call_osmux.py: using LAC 28067 11:26:34.976265 tst mo_mt_call_osmux.py: using RAC 17 11:26:35.120499 tst mo_mt_call_osmux.py: using CellId 28067 11:26:35.251431 tst mo_mt_call_osmux.py: using BVCI 28068 11:26:35.374676 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:35.386271 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:35.397647 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:35.408852 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:35.420287 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:26:35.431682 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:26:35.548511 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:26:35.675679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:36.196272 run create_hlr_db(pid=2077): Launched 11:26:36.331310 bus /sierra_2: Setting Powered False 11:26:37.396697 run create_hlr_db(pid=2077): Terminated: ok {rc=0} 11:26:37.843009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2079): Launched 11:26:38.155983 run osmo-hlr_10.42.42.2(pid=2080): Launched 11:26:38.274271 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:38.827847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2082): Launched 11:26:39.141425 run osmo-stp_10.42.42.5(pid=2083): Launched 11:26:39.259700 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:39.822522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2085): Launched 11:26:40.136651 run osmo-msc_10.42.42.6(pid=2086): Launched 11:26:40.311718 run osmo-stp_10.42.42.5(pid=2083): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2083)] 11:26:40.445737 run osmo-stp_10.42.42.5(pid=2083): stdout: | (launched: 2022-12-10_11:26:39.082233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:40.577900 run osmo-stp_10.42.42.5(pid=2083): stderr: | 20221210112639255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112639256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112639256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112639256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112639258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112639259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112639259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:40.708014 run osmo-stp_10.42.42.5(pid=2083): stdout: | (launched: 2022-12-10_11:26:39.082233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:40.833283 run osmo-stp_10.42.42.5(pid=2083): stderr: | 20221210112639255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112639256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112639256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112639256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112639258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112639259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112639259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:40.982409 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2083): Process ended prematurely: osmo-stp_10.42.42.5(pid=2083) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2083)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:26:40.991494 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:26:41.019055 run osmo-hlr_10.42.42.2(pid=2080): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2080)] 11:26:41.067640 run osmo-hlr_10.42.42.2(pid=2080): stdout: | (launched: 2022-12-10_11:26:38.096493) 11:26:41.117806 run osmo-hlr_10.42.42.2(pid=2080): stderr: | 20221210112638278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112638278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112638278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112638278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112638278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112638278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112638291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112638301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112638301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112638301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:41.187514 run osmo-msc_10.42.42.6(pid=2086): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2086)] 11:26:41.235990 run osmo-msc_10.42.42.6(pid=2086): stdout: | (launched: 2022-12-10_11:26:40.077537) 11:26:41.286081 run osmo-msc_10.42.42.6(pid=2086): stderr: | 20221210112640353 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112640353 DLGLOBAL DEBUG validating counter group 0x7fed31654c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112640353 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112640353 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112640353 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112640353 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112640355 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112640355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112640357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112640357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:41.336802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2079): Terminating (SIGTERM) 11:26:41.377001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2082): Terminating (SIGTERM) 11:26:41.417061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2085): Terminating (SIGTERM) 11:26:41.457630 --- ParallelTerminationStrategy: PID 2079 died... 11:26:41.476838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2079): Terminated: ok {rc=0} 11:26:41.521887 --- ParallelTerminationStrategy: PID 2082 died... 11:26:41.540467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2082): Terminated: ok {rc=0} 11:26:41.585503 --- ParallelTerminationStrategy: PID 2085 died... 11:26:41.604265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2085): Terminated: ok {rc=0} 11:26:41.690612 bus /sierra_3: Setting Powered False 11:26:42.790137 bus /sierra_3: Setting Powered False 11:26:43.906269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:26:45.137408 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:45.143788 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:26:45.165233 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:26:45.193564 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:26:45.248280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:26:45.270139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:26:45.298109 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:26:45.850311 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:26:45.904414 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:45.916774 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:26:45.975625 tst mo_mt_call.py: using LAC 28068 11:26:46.122784 tst mo_mt_call.py: using RAC 18 11:26:46.255741 tst mo_mt_call.py: using CellId 28068 11:26:46.385073 tst mo_mt_call.py: using BVCI 28069 11:26:46.523898 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:46.535971 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:46.547796 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:46.560918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:46.573069 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:46.585446 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:26:46.711827 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:26:46.869095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:47.382185 run create_hlr_db(pid=2091): Launched 11:26:47.501756 bus /sierra_2: Setting Powered False 11:26:48.563538 run create_hlr_db(pid=2091): Terminated: ok {rc=0} 11:26:48.999331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2093): Launched 11:26:49.313172 run osmo-hlr_10.42.42.2(pid=2094): Launched 11:26:49.432133 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:49.984689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2096): Launched 11:26:50.297968 run osmo-stp_10.42.42.5(pid=2097): Launched 11:26:50.416114 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:50.978281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2099): Launched 11:26:51.291787 run osmo-msc_10.42.42.6(pid=2100): Launched 11:26:51.465196 run osmo-stp_10.42.42.5(pid=2097): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2097)] 11:26:51.596848 run osmo-stp_10.42.42.5(pid=2097): stdout: | (launched: 2022-12-10_11:26:50.238598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:51.727978 run osmo-stp_10.42.42.5(pid=2097): stderr: | 20221210112650415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112650415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112650415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112650415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112650416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112650416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112650416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:51.857132 run osmo-stp_10.42.42.5(pid=2097): stdout: | (launched: 2022-12-10_11:26:50.238598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:51.981309 run osmo-stp_10.42.42.5(pid=2097): stderr: | 20221210112650415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112650415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112650415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112650415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112650416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112650416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112650416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:52.129878 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2097): Process ended prematurely: osmo-stp_10.42.42.5(pid=2097) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2097)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:26:52.138742 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:26:52.165678 run osmo-hlr_10.42.42.2(pid=2094): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2094)] 11:26:52.213649 run osmo-hlr_10.42.42.2(pid=2094): stdout: | (launched: 2022-12-10_11:26:49.254097) 11:26:52.263315 run osmo-hlr_10.42.42.2(pid=2094): stderr: | 20221210112649433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112649433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112649433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112649433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112649433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112649433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112649446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112649454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112649454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112649454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:52.332770 run osmo-msc_10.42.42.6(pid=2100): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2100)] 11:26:52.380745 run osmo-msc_10.42.42.6(pid=2100): stdout: | (launched: 2022-12-10_11:26:51.232591) 11:26:52.430257 run osmo-msc_10.42.42.6(pid=2100): stderr: | 20221210112651508 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112651508 DLGLOBAL DEBUG validating counter group 0x7f6237841c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112651509 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112651509 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112651509 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112651509 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112651511 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112651511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112651511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112651511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:52.480319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2093): Terminating (SIGTERM) 11:26:52.519974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2096): Terminating (SIGTERM) 11:26:52.559667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2099): Terminating (SIGTERM) 11:26:52.599903 --- ParallelTerminationStrategy: PID 2093 died... 11:26:52.618980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2093): Terminated: ok {rc=0} 11:26:52.663191 --- ParallelTerminationStrategy: PID 2096 died... 11:26:52.681679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2096): Terminated: ok {rc=0} 11:26:52.726397 --- ParallelTerminationStrategy: PID 2099 died... 11:26:52.744988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2099): Terminated: ok {rc=0} 11:26:52.831166 bus /sierra_3: Setting Powered False 11:26:53.931813 bus /sierra_3: Setting Powered False 11:26:55.048474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:26:56.194055 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:56.205953 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:26:56.261125 tst mo_mt_call_osmux.py: using LAC 28069 11:26:56.381657 tst mo_mt_call_osmux.py: using RAC 19 11:26:56.501917 tst mo_mt_call_osmux.py: using CellId 28069 11:26:56.625386 tst mo_mt_call_osmux.py: using BVCI 28070 11:26:56.738198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:56.749410 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:56.760279 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:56.771385 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:56.782939 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:26:56.794070 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:26:56.912035 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:26:57.028044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:57.513749 run create_hlr_db(pid=2102): Launched 11:26:57.631624 bus /sierra_2: Setting Powered False 11:26:58.692443 run create_hlr_db(pid=2102): Terminated: ok {rc=0} 11:26:59.149562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2104): Launched 11:26:59.484816 run osmo-hlr_10.42.42.2(pid=2105): Launched 11:26:59.613064 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:00.189551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2107): Launched 11:27:00.523663 run osmo-stp_10.42.42.5(pid=2108): Launched 11:27:00.653701 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:01.248211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2110): Launched 11:27:01.587709 run osmo-msc_10.42.42.6(pid=2111): Launched 11:27:02.019466 run osmo-stp_10.42.42.5(pid=2108): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2108)] 11:27:02.295664 run osmo-stp_10.42.42.5(pid=2108): stdout: | (launched: 2022-12-10_11:27:00.460738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:02.431599 run osmo-stp_10.42.42.5(pid=2108): stderr: | 20221210112700658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112700658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112700658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112700659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112700659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112700659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112700659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:02.562640 run osmo-stp_10.42.42.5(pid=2108): stdout: | (launched: 2022-12-10_11:27:00.460738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:02.688117 run osmo-stp_10.42.42.5(pid=2108): stderr: | 20221210112700658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112700658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112700658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112700659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112700659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112700659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112700659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:02.837771 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2108): Process ended prematurely: osmo-stp_10.42.42.5(pid=2108) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2108)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:27:02.846884 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 11:27:02.874460 run osmo-hlr_10.42.42.2(pid=2105): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2105)] 11:27:02.923442 run osmo-hlr_10.42.42.2(pid=2105): stdout: | (launched: 2022-12-10_11:26:59.421931) 11:27:02.974114 run osmo-hlr_10.42.42.2(pid=2105): stderr: | 20221210112659624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112659624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112659624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112659624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112659624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112659624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112659636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112659646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112659646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112659646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:03.044242 run osmo-msc_10.42.42.6(pid=2111): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2111)] 11:27:03.093087 run osmo-msc_10.42.42.6(pid=2111): stdout: | (launched: 2022-12-10_11:27:01.523306) 11:27:03.143074 run osmo-msc_10.42.42.6(pid=2111): stderr: | 20221210112701972 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112701972 DLGLOBAL DEBUG validating counter group 0x7fc21175bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112701973 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112701974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112701974 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112701974 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112701976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112701976 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112701978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112701978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:03.193868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2104): Terminating (SIGTERM) 11:27:03.234386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2107): Terminating (SIGTERM) 11:27:03.274970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2110): Terminating (SIGTERM) 11:27:03.316001 --- ParallelTerminationStrategy: PID 2104 died... 11:27:03.335450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2104): Terminated: ok {rc=0} 11:27:03.381150 --- ParallelTerminationStrategy: PID 2107 died... 11:27:03.400103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2107): Terminated: ok {rc=0} 11:27:03.445411 --- ParallelTerminationStrategy: PID 2110 died... 11:27:03.464435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2110): Terminated: ok {rc=0} 11:27:03.551444 bus /sierra_3: Setting Powered False 11:27:04.650932 bus /sierra_3: Setting Powered False 11:27:05.767183 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:27:07.001578 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:07.008049 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:27:07.029599 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:27:07.056382 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:27:07.110124 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:27:07.131127 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:27:07.157651 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:27:07.703773 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:27:07.754421 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:07.765715 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:27:07.821323 tst mo_mt_call.py: using LAC 28070 11:27:07.945306 tst mo_mt_call.py: using RAC 20 11:27:08.076880 tst mo_mt_call.py: using CellId 28070 11:27:08.207047 tst mo_mt_call.py: using BVCI 28071 11:27:08.329851 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:08.341554 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:08.352832 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:08.364314 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:08.375790 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:08.387275 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:27:08.508533 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:27:08.627976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:09.114066 run create_hlr_db(pid=2116): Launched 11:27:09.233315 bus /sierra_2: Setting Powered False 11:27:10.295628 run create_hlr_db(pid=2116): Terminated: ok {rc=0} 11:27:10.753417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2118): Launched 11:27:11.091844 run osmo-hlr_10.42.42.2(pid=2119): Launched 11:27:11.220069 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:11.795256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2121): Launched 11:27:12.131540 run osmo-stp_10.42.42.5(pid=2122): Launched 11:27:12.258177 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:12.862215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2124): Launched 11:27:13.197583 run osmo-msc_10.42.42.6(pid=2125): Launched 11:27:13.382791 run osmo-stp_10.42.42.5(pid=2122): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2122)] 11:27:13.521660 run osmo-stp_10.42.42.5(pid=2122): stdout: | (launched: 2022-12-10_11:27:12.068420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:13.661319 run osmo-stp_10.42.42.5(pid=2122): stderr: | 20221210112712264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112712264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112712264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112712265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112712267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112712267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112712267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:13.799801 run osmo-stp_10.42.42.5(pid=2122): stdout: | (launched: 2022-12-10_11:27:12.068420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:13.932260 run osmo-stp_10.42.42.5(pid=2122): stderr: | 20221210112712264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112712264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112712264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112712265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112712267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112712267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112712267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:14.092155 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2122): Process ended prematurely: osmo-stp_10.42.42.5(pid=2122) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2122)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:27:14.101867 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:27:14.129732 run osmo-hlr_10.42.42.2(pid=2119): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2119)] 11:27:14.179940 run osmo-hlr_10.42.42.2(pid=2119): stdout: | (launched: 2022-12-10_11:27:11.028823) 11:27:14.231924 run osmo-hlr_10.42.42.2(pid=2119): stderr: | 20221210112711232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112711232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112711232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112711232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112711232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112711232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112711245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112711254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112711254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112711254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:14.304209 run osmo-msc_10.42.42.6(pid=2125): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2125)] 11:27:14.354458 run osmo-msc_10.42.42.6(pid=2125): stdout: | (launched: 2022-12-10_11:27:13.134833) 11:27:14.406291 run osmo-msc_10.42.42.6(pid=2125): stderr: | 20221210112713460 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112713461 DLGLOBAL DEBUG validating counter group 0x7f3cad65fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112713461 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112713461 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112713461 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112713461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112713463 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112713463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112713463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112713463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:14.458464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2118): Terminating (SIGTERM) 11:27:14.500104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2121): Terminating (SIGTERM) 11:27:14.541920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2124): Terminating (SIGTERM) 11:27:14.583873 --- ParallelTerminationStrategy: PID 2118 died... 11:27:14.603963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2118): Terminated: ok {rc=0} 11:27:14.650457 --- ParallelTerminationStrategy: PID 2121 died... 11:27:14.670248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2121): Terminated: ok {rc=0} 11:27:14.716286 --- ParallelTerminationStrategy: PID 2124 died... 11:27:14.736036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2124): Terminated: ok {rc=0} 11:27:14.825153 bus /sierra_3: Setting Powered False 11:27:15.931713 bus /sierra_3: Setting Powered False 11:27:17.061781 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:27:18.215885 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:18.228274 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:27:18.286922 tst mo_mt_call_osmux.py: using LAC 28071 11:27:18.419329 tst mo_mt_call_osmux.py: using RAC 21 11:27:18.550578 tst mo_mt_call_osmux.py: using CellId 28071 11:27:18.681403 tst mo_mt_call_osmux.py: using BVCI 28072 11:27:18.803996 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:18.815578 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:18.826990 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:18.838409 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:18.849858 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:27:18.861271 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:27:18.979228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:27:19.099346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:19.619821 run create_hlr_db(pid=2127): Launched 11:27:19.755139 bus /sierra_2: Setting Powered False 11:27:20.820879 run create_hlr_db(pid=2127): Terminated: ok {rc=0} 11:27:21.286502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2129): Launched 11:27:21.621951 run osmo-hlr_10.42.42.2(pid=2130): Launched 11:27:21.748048 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:22.322482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2132): Launched 11:27:22.656203 run osmo-stp_10.42.42.5(pid=2133): Launched 11:27:22.782592 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:23.384773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2135): Launched 11:27:23.719708 run osmo-msc_10.42.42.6(pid=2136): Launched 11:27:23.904196 run osmo-stp_10.42.42.5(pid=2133): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2133)] 11:27:24.044201 run osmo-stp_10.42.42.5(pid=2133): stdout: | (launched: 2022-12-10_11:27:22.593667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:24.184287 run osmo-stp_10.42.42.5(pid=2133): stderr: | 20221210112722791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112722791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112722791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112722792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112722792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112722792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112722792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:24.323165 run osmo-stp_10.42.42.5(pid=2133): stdout: | (launched: 2022-12-10_11:27:22.593667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:24.456009 run osmo-stp_10.42.42.5(pid=2133): stderr: | 20221210112722791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112722791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112722791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112722792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112722792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112722792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112722792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:24.614664 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2133): Process ended prematurely: osmo-stp_10.42.42.5(pid=2133) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2133)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:27:24.624338 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:27:24.652356 run osmo-hlr_10.42.42.2(pid=2130): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2130)] 11:27:24.702689 run osmo-hlr_10.42.42.2(pid=2130): stdout: | (launched: 2022-12-10_11:27:21.558957) 11:27:24.754453 run osmo-hlr_10.42.42.2(pid=2130): stderr: | 20221210112721765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112721765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112721765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112721765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112721765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112721765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112721777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112721785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112721786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112721786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:24.826807 run osmo-msc_10.42.42.6(pid=2136): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2136)] 11:27:24.876850 run osmo-msc_10.42.42.6(pid=2136): stdout: | (launched: 2022-12-10_11:27:23.656609) 11:27:24.928376 run osmo-msc_10.42.42.6(pid=2136): stderr: | 20221210112723984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112723984 DLGLOBAL DEBUG validating counter group 0x7fd177283c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112723984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112723984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112723984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112723985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112723988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112723989 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112723989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112723989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:24.980671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2129): Terminating (SIGTERM) 11:27:25.022331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2132): Terminating (SIGTERM) 11:27:25.064188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2135): Terminating (SIGTERM) 11:27:25.106522 --- ParallelTerminationStrategy: PID 2129 died... 11:27:25.126723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2129): Terminated: ok {rc=0} 11:27:25.173244 --- ParallelTerminationStrategy: PID 2132 died... 11:27:25.192892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2132): Terminated: ok {rc=0} 11:27:25.239143 --- ParallelTerminationStrategy: PID 2135 died... 11:27:25.258895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2135): Terminated: ok {rc=0} 11:27:25.346340 bus /sierra_3: Setting Powered False 11:27:26.445161 bus /sierra_3: Setting Powered False 11:27:27.561064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:27:28.794517 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:28.801001 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:27:28.822627 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:27:28.849202 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:27:28.900776 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:27:28.921145 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:27:28.947725 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:27:29.496277 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:27:29.546748 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:29.557904 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:27:29.613677 tst mo_mt_call.py: using LAC 28072 11:27:29.747708 tst mo_mt_call.py: using RAC 22 11:27:29.880650 tst mo_mt_call.py: using CellId 28072 11:27:30.012197 tst mo_mt_call.py: using BVCI 28073 11:27:30.133375 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:30.144940 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:30.156580 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:30.168494 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:30.180186 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:30.191650 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:27:30.311906 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:27:30.430296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:30.946161 run create_hlr_db(pid=2142): Launched 11:27:31.106204 bus /sierra_2: Setting Powered False 11:27:32.176880 run create_hlr_db(pid=2142): Terminated: ok {rc=0} 11:27:32.629524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2144): Launched 11:27:32.942557 run osmo-hlr_10.42.42.2(pid=2145): Launched 11:27:33.060791 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:33.614612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2147): Launched 11:27:33.928216 run osmo-stp_10.42.42.5(pid=2148): Launched 11:27:34.047288 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:34.613636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2150): Launched 11:27:34.927624 run osmo-msc_10.42.42.6(pid=2151): Launched 11:27:35.102581 run osmo-stp_10.42.42.5(pid=2148): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2148)] 11:27:35.235230 run osmo-stp_10.42.42.5(pid=2148): stdout: | (launched: 2022-12-10_11:27:33.868668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:35.367007 run osmo-stp_10.42.42.5(pid=2148): stderr: | 20221210112734044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112734044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112734044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112734044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112734045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112734045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112734045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:35.496533 run osmo-stp_10.42.42.5(pid=2148): stdout: | (launched: 2022-12-10_11:27:33.868668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:35.621271 run osmo-stp_10.42.42.5(pid=2148): stderr: | 20221210112734044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112734044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112734044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112734044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112734045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112734045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112734045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:35.770214 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2148): Process ended prematurely: osmo-stp_10.42.42.5(pid=2148) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2148)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:27:35.779051 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:27:35.805778 run osmo-hlr_10.42.42.2(pid=2145): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2145)] 11:27:35.854160 run osmo-hlr_10.42.42.2(pid=2145): stdout: | (launched: 2022-12-10_11:27:32.883448) 11:27:35.903817 run osmo-hlr_10.42.42.2(pid=2145): stderr: | 20221210112733065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112733065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112733065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112733065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112733065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112733065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112733078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112733086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112733086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112733086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:35.976537 run osmo-msc_10.42.42.6(pid=2151): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2151)] 11:27:36.030205 run osmo-msc_10.42.42.6(pid=2151): stdout: | (launched: 2022-12-10_11:27:34.867980) 11:27:36.082855 run osmo-msc_10.42.42.6(pid=2151): stderr: | 20221210112735145 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112735145 DLGLOBAL DEBUG validating counter group 0x7f9766a0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112735145 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112735145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112735145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112735145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112735147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112735147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112735148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112735148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:36.135727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2144): Terminating (SIGTERM) 11:27:36.178453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2147): Terminating (SIGTERM) 11:27:36.221633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2150): Terminating (SIGTERM) 11:27:36.264817 --- ParallelTerminationStrategy: PID 2144 died... 11:27:36.285031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2144): Terminated: ok {rc=0} 11:27:36.332565 --- ParallelTerminationStrategy: PID 2147 died... 11:27:36.352250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2147): Terminated: ok {rc=0} 11:27:36.399718 --- ParallelTerminationStrategy: PID 2150 died... 11:27:36.419447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2150): Terminated: ok {rc=0} 11:27:36.507745 bus /sierra_3: Setting Powered False 11:27:37.607372 bus /sierra_3: Setting Powered False 11:27:38.722568 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:27:39.873969 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:39.886292 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:27:39.944589 tst mo_mt_call_osmux.py: using LAC 28073 11:27:40.077461 tst mo_mt_call_osmux.py: using RAC 23 11:27:40.209085 tst mo_mt_call_osmux.py: using CellId 28073 11:27:40.340846 tst mo_mt_call_osmux.py: using BVCI 28074 11:27:40.463651 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:40.475209 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:40.486546 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:40.497881 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:40.509317 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:27:40.520581 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:27:40.637470 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:27:40.758559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:41.278867 run create_hlr_db(pid=2156): Launched 11:27:41.415764 bus /sierra_2: Setting Powered False 11:27:42.480651 run create_hlr_db(pid=2156): Terminated: ok {rc=0} 11:27:42.926885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2158): Launched 11:27:43.240794 run osmo-hlr_10.42.42.2(pid=2159): Launched 11:27:43.360104 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:43.896646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2161): Launched 11:27:44.203029 run osmo-stp_10.42.42.5(pid=2162): Launched 11:27:44.319593 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:44.871950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2164): Launched 11:27:45.179865 run osmo-msc_10.42.42.6(pid=2165): Launched 11:27:45.351012 run osmo-stp_10.42.42.5(pid=2162): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2162)] 11:27:45.479473 run osmo-stp_10.42.42.5(pid=2162): stdout: | (launched: 2022-12-10_11:27:44.144841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:45.608885 run osmo-stp_10.42.42.5(pid=2162): stderr: | 20221210112744316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112744316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112744317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112744317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112744319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112744320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112744320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:45.735662 run osmo-stp_10.42.42.5(pid=2162): stdout: | (launched: 2022-12-10_11:27:44.144841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:45.862592 run osmo-stp_10.42.42.5(pid=2162): stderr: | 20221210112744316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112744316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112744317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112744317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112744319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112744320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112744320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:46.030116 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2162): Process ended prematurely: osmo-stp_10.42.42.5(pid=2162) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2162)] [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:27:46.039761 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:27:46.068821 run osmo-hlr_10.42.42.2(pid=2159): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2159)] 11:27:46.118902 run osmo-hlr_10.42.42.2(pid=2159): stdout: | (launched: 2022-12-10_11:27:43.181576) 11:27:46.170549 run osmo-hlr_10.42.42.2(pid=2159): stderr: | 20221210112743365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112743365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112743365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112743365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112743365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112743365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112743417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112743428 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112743428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112743428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:46.242040 run osmo-msc_10.42.42.6(pid=2165): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2165)] 11:27:46.292419 run osmo-msc_10.42.42.6(pid=2165): stdout: | (launched: 2022-12-10_11:27:45.122008) 11:27:46.344415 run osmo-msc_10.42.42.6(pid=2165): stderr: | 20221210112745395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112745395 DLGLOBAL DEBUG validating counter group 0x7f8bd9026c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112745395 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112745395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112745396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112745396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112745398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112745398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112745398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112745398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:46.396920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2158): Terminating (SIGTERM) 11:27:46.439183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2161): Terminating (SIGTERM) 11:27:46.481870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2164): Terminating (SIGTERM) 11:27:46.526421 --- ParallelTerminationStrategy: PID 2158 died... 11:27:46.546342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2158): Terminated: ok {rc=0} 11:27:46.594928 --- ParallelTerminationStrategy: PID 2161 died... 11:27:46.614731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2161): Terminated: ok {rc=0} 11:27:46.662241 --- ParallelTerminationStrategy: PID 2164 died... 11:27:46.681824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2164): Terminated: ok {rc=0} 11:27:46.769535 bus /sierra_3: Setting Powered False 11:27:47.865961 bus /sierra_3: Setting Powered False 11:27:48.980696 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:27:50.216247 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:50.222780 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:27:50.243041 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:27:50.269759 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:27:50.320711 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:27:50.340784 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:27:50.367093 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:27:50.915910 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:27:50.965305 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:27:50.976132 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:27:51.031414 tst mo_mt_call.py: using LAC 28074 11:27:51.151517 tst mo_mt_call.py: using RAC 24 11:27:51.275212 tst mo_mt_call.py: using CellId 28074 11:27:51.393642 tst mo_mt_call.py: using BVCI 28075 11:27:51.514045 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:27:51.525751 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:27:51.537160 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:27:51.548479 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:27:51.559864 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:27:51.571322 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:27:51.685938 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:27:51.801225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:52.299148 run create_hlr_db(pid=2170): Launched 11:27:52.417002 bus /sierra_2: Setting Powered False 11:27:53.477659 run create_hlr_db(pid=2170): Terminated: ok {rc=0} 11:27:53.926737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2172): Launched 11:27:54.255801 run osmo-hlr_10.42.42.2(pid=2173): Launched 11:27:54.381542 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:54.944233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2175): Launched 11:27:55.272599 run osmo-stp_10.42.42.5(pid=2176): Launched 11:27:55.397218 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:55.988169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2178): Launched 11:27:56.318520 run osmo-msc_10.42.42.6(pid=2179): Launched 11:27:56.501065 run osmo-stp_10.42.42.5(pid=2176): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2176)] 11:27:56.638828 run osmo-stp_10.42.42.5(pid=2176): stdout: | (launched: 2022-12-10_11:27:55.211582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:56.776410 run osmo-stp_10.42.42.5(pid=2176): stderr: | 20221210112755407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112755407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112755407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112755407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112755408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112755408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112755408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:56.913195 run osmo-stp_10.42.42.5(pid=2176): stdout: | (launched: 2022-12-10_11:27:55.211582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:57.043876 run osmo-stp_10.42.42.5(pid=2176): stderr: | 20221210112755407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112755407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112755407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112755407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112755408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112755408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112755408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:57.200160 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2176): Process ended prematurely: osmo-stp_10.42.42.5(pid=2176) [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2176)] [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:27:57.209729 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:27:57.237491 run osmo-hlr_10.42.42.2(pid=2173): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2173)] 11:27:57.287258 run osmo-hlr_10.42.42.2(pid=2173): stdout: | (launched: 2022-12-10_11:27:54.194539) 11:27:57.338776 run osmo-hlr_10.42.42.2(pid=2173): stderr: | 20221210112754396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112754397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112754397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112754397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112754397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112754397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112754409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112754417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112754418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112754418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:57.410700 run osmo-msc_10.42.42.6(pid=2179): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2179)] 11:27:57.460631 run osmo-msc_10.42.42.6(pid=2179): stdout: | (launched: 2022-12-10_11:27:56.257333) 11:27:57.512244 run osmo-msc_10.42.42.6(pid=2179): stderr: | 20221210112756583 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112756583 DLGLOBAL DEBUG validating counter group 0x7f9f2800fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112756583 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112756583 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112756584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112756584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112756585 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112756586 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112756586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112756586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:57.564023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2172): Terminating (SIGTERM) 11:27:57.605390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2175): Terminating (SIGTERM) 11:27:57.646795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2178): Terminating (SIGTERM) 11:27:57.688612 --- ParallelTerminationStrategy: PID 2172 died... 11:27:57.708497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2172): Terminated: ok {rc=0} 11:27:57.754465 --- ParallelTerminationStrategy: PID 2175 died... 11:27:57.773983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2175): Terminated: ok {rc=0} 11:27:57.820002 --- ParallelTerminationStrategy: PID 2178 died... 11:27:57.839614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2178): Terminated: ok {rc=0} 11:27:57.927458 bus /sierra_3: Setting Powered False 11:27:59.026056 bus /sierra_3: Setting Powered False 11:28:00.142279 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:28:01.292598 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:28:01.305937 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:28:01.364760 tst mo_mt_call_osmux.py: using LAC 28075 11:28:01.509036 tst mo_mt_call_osmux.py: using RAC 25 11:28:01.632930 tst mo_mt_call_osmux.py: using CellId 28075 11:28:01.759344 tst mo_mt_call_osmux.py: using BVCI 28076 11:28:01.882581 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:28:01.895019 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:28:01.907380 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:28:01.919435 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:28:01.932544 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:28:01.948068 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:28:02.077703 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:28:02.197120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:02.676616 run create_hlr_db(pid=2181): Launched 11:28:02.794528 bus /sierra_2: Setting Powered False 11:28:03.855608 run create_hlr_db(pid=2181): Terminated: ok {rc=0} 11:28:04.282998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2183): Launched 11:28:04.591456 run osmo-hlr_10.42.42.2(pid=2184): Launched 11:28:04.708199 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:05.236572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2186): Launched 11:28:05.544350 run osmo-stp_10.42.42.5(pid=2187): Launched 11:28:05.661585 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:06.214117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2189): Launched 11:28:06.521315 run osmo-msc_10.42.42.6(pid=2190): Launched 11:28:06.692210 run osmo-stp_10.42.42.5(pid=2187): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2187)] 11:28:06.822024 run osmo-stp_10.42.42.5(pid=2187): stdout: | (launched: 2022-12-10_11:28:05.486352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:06.951610 run osmo-stp_10.42.42.5(pid=2187): stderr: | 20221210112805659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112805659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112805660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112805660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112805661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112805661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112805661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:07.078901 run osmo-stp_10.42.42.5(pid=2187): stdout: | (launched: 2022-12-10_11:28:05.486352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:07.200350 run osmo-stp_10.42.42.5(pid=2187): stderr: | 20221210112805659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112805659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112805660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112805660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112805661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112805661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112805661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:07.346339 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2187): Process ended prematurely: osmo-stp_10.42.42.5(pid=2187) [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2187)] [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:28:07.355027 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:28:07.382199 run osmo-hlr_10.42.42.2(pid=2184): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2184)] 11:28:07.430301 run osmo-hlr_10.42.42.2(pid=2184): stdout: | (launched: 2022-12-10_11:28:04.533441) 11:28:07.480532 run osmo-hlr_10.42.42.2(pid=2184): stderr: | 20221210112804711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112804711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112804711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112804712 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112804712 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112804712 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112804724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112804732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112804733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112804733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:07.551026 run osmo-msc_10.42.42.6(pid=2190): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2190)] 11:28:07.599959 run osmo-msc_10.42.42.6(pid=2190): stdout: | (launched: 2022-12-10_11:28:06.463198) 11:28:07.649875 run osmo-msc_10.42.42.6(pid=2190): stderr: | 20221210112806739 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112806739 DLGLOBAL DEBUG validating counter group 0x7f237d80dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112806739 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112806739 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112806739 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112806740 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112806741 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112806742 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112806742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112806742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:07.700120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2183): Terminating (SIGTERM) 11:28:07.739850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2186): Terminating (SIGTERM) 11:28:07.779664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2189): Terminating (SIGTERM) 11:28:07.820028 --- ParallelTerminationStrategy: PID 2183 died... 11:28:07.838897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2183): Terminated: ok {rc=0} 11:28:07.883709 --- ParallelTerminationStrategy: PID 2186 died... 11:28:07.902398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2186): Terminated: ok {rc=0} 11:28:07.946922 --- ParallelTerminationStrategy: PID 2189 died... 11:28:07.965729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2189): Terminated: ok {rc=0} 11:28:08.049337 bus /sierra_3: Setting Powered False 11:28:09.146371 bus /sierra_3: Setting Powered False 11:28:10.262887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:28:11.491444 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:11.497068 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:28:11.518170 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:28:11.545332 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:28:11.598405 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:28:11.619089 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:28:11.645068 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:28:12.191392 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:28:12.240870 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:12.251708 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:28:12.307590 tst mo_mt_call.py: using LAC 28076 11:28:12.428649 tst mo_mt_call.py: using RAC 26 11:28:12.548861 tst mo_mt_call.py: using CellId 28076 11:28:12.672332 tst mo_mt_call.py: using BVCI 28077 11:28:12.792856 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:12.804339 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:12.815615 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:12.826826 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:12.838062 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:12.849290 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:28:12.962956 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:28:13.081103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:13.589059 run create_hlr_db(pid=2195): Launched 11:28:13.710961 bus /sierra_2: Setting Powered False 11:28:14.771821 run create_hlr_db(pid=2195): Terminated: ok {rc=0} 11:28:15.192591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2197): Launched 11:28:15.495319 run osmo-hlr_10.42.42.2(pid=2198): Launched 11:28:15.610674 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:16.177271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2200): Launched 11:28:16.503591 run osmo-stp_10.42.42.5(pid=2201): Launched 11:28:16.730278 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:17.381120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2203): Launched 11:28:17.707015 run osmo-msc_10.42.42.6(pid=2204): Launched 11:28:17.884808 run osmo-stp_10.42.42.5(pid=2201): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2201)] 11:28:18.020023 run osmo-stp_10.42.42.5(pid=2201): stdout: | (launched: 2022-12-10_11:28:16.442472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:18.155666 run osmo-stp_10.42.42.5(pid=2201): stderr: | 20221210112816795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112816795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112816795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112816795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112816796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112816796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112816796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:18.290660 run osmo-stp_10.42.42.5(pid=2201): stdout: | (launched: 2022-12-10_11:28:16.442472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:18.418833 run osmo-stp_10.42.42.5(pid=2201): stderr: | 20221210112816795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112816795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112816795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112816795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112816796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112816796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112816796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:18.572436 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2201): Process ended prematurely: osmo-stp_10.42.42.5(pid=2201) [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2201)] [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:28:18.582179 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:28:18.609889 run osmo-hlr_10.42.42.2(pid=2198): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2198)] 11:28:18.659309 run osmo-hlr_10.42.42.2(pid=2198): stdout: | (launched: 2022-12-10_11:28:15.437612) 11:28:18.710530 run osmo-hlr_10.42.42.2(pid=2198): stderr: | 20221210112815614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112815614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112815614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112815614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112815614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112815614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112815635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112815644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112815644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112815644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:18.781953 run osmo-msc_10.42.42.6(pid=2204): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2204)] 11:28:18.831213 run osmo-msc_10.42.42.6(pid=2204): stdout: | (launched: 2022-12-10_11:28:17.643154) 11:28:18.882375 run osmo-msc_10.42.42.6(pid=2204): stderr: | 20221210112817971 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112817971 DLGLOBAL DEBUG validating counter group 0x7fba51704c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112817972 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112817972 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112817972 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112817972 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112817974 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112817974 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112817974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112817974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:18.933653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2197): Terminating (SIGTERM) 11:28:18.974706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2200): Terminating (SIGTERM) 11:28:19.017629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2203): Terminating (SIGTERM) 11:28:19.059873 --- ParallelTerminationStrategy: PID 2197 died... 11:28:19.079828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2197): Terminated: ok {rc=0} 11:28:19.125858 --- ParallelTerminationStrategy: PID 2200 died... 11:28:19.145220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2200): Terminated: ok {rc=0} 11:28:19.191483 --- ParallelTerminationStrategy: PID 2203 died... 11:28:19.211119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2203): Terminated: ok {rc=0} 11:28:19.298174 bus /sierra_3: Setting Powered False 11:28:20.397310 bus /sierra_3: Setting Powered False 11:28:21.514618 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:28:22.658890 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:22.670394 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:28:22.727101 tst mo_mt_call_osmux.py: using LAC 28077 11:28:22.845501 tst mo_mt_call_osmux.py: using RAC 27 11:28:22.973101 tst mo_mt_call_osmux.py: using CellId 28077 11:28:23.096469 tst mo_mt_call_osmux.py: using BVCI 28078 11:28:23.205726 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:23.216660 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:23.227344 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:23.238294 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:23.249350 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:28:23.260207 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:28:23.375941 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:28:23.490269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:23.991951 run create_hlr_db(pid=2206): Launched 11:28:24.122009 bus /sierra_2: Setting Powered False 11:28:25.186123 run create_hlr_db(pid=2206): Terminated: ok {rc=0} 11:28:25.617739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2208): Launched 11:28:25.920121 run osmo-hlr_10.42.42.2(pid=2209): Launched 11:28:26.033887 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:26.573974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2211): Launched 11:28:26.876590 run osmo-stp_10.42.42.5(pid=2212): Launched 11:28:26.990023 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:27.536456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2214): Launched 11:28:27.841211 run osmo-msc_10.42.42.6(pid=2215): Launched 11:28:28.008180 run osmo-stp_10.42.42.5(pid=2212): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2212)] 11:28:28.135073 run osmo-stp_10.42.42.5(pid=2212): stdout: | (launched: 2022-12-10_11:28:26.818269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:28.262246 run osmo-stp_10.42.42.5(pid=2212): stderr: | 20221210112826991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112826991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112826991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112826992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112826992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112826992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112826992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:28.386440 run osmo-stp_10.42.42.5(pid=2212): stdout: | (launched: 2022-12-10_11:28:26.818269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:28.505831 run osmo-stp_10.42.42.5(pid=2212): stderr: | 20221210112826991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112826991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112826991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112826992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112826992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112826992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112826992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:28.649506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2212): Process ended prematurely: osmo-stp_10.42.42.5(pid=2212) [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2212)] [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:28:28.658478 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:28:28.684925 run osmo-hlr_10.42.42.2(pid=2209): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2209)] 11:28:28.732632 run osmo-hlr_10.42.42.2(pid=2209): stdout: | (launched: 2022-12-10_11:28:25.862353) 11:28:28.782013 run osmo-hlr_10.42.42.2(pid=2209): stderr: | 20221210112826040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112826040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112826040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112826040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112826040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112826040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112826058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112826067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112826067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112826067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:28.850625 run osmo-msc_10.42.42.6(pid=2215): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2215)] 11:28:28.898148 run osmo-msc_10.42.42.6(pid=2215): stdout: | (launched: 2022-12-10_11:28:27.782091) 11:28:28.947163 run osmo-msc_10.42.42.6(pid=2215): stderr: | 20221210112828058 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112828059 DLGLOBAL DEBUG validating counter group 0x7f2a959dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112828059 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112828059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112828059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112828059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112828061 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112828061 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112828062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112828062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:28.996578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2208): Terminating (SIGTERM) 11:28:29.035664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2211): Terminating (SIGTERM) 11:28:29.075471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2214): Terminating (SIGTERM) 11:28:29.115126 --- ParallelTerminationStrategy: PID 2208 died... 11:28:29.134162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2208): Terminated: ok {rc=0} 11:28:29.178077 --- ParallelTerminationStrategy: PID 2211 died... 11:28:29.196358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2211): Terminated: ok {rc=0} 11:28:29.244537 --- ParallelTerminationStrategy: PID 2214 died... 11:28:29.264034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2214): Terminated: ok {rc=0} 11:28:29.350157 bus /sierra_3: Setting Powered False 11:28:30.447245 bus /sierra_3: Setting Powered False 11:28:31.556805 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:oc2g --------------------------------------------------------------------- 11:28:32.792286 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:32.796648 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 11:28:32.817466 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 11:28:32.844372 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 11:28:32.929466 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 11:28:32.950293 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 11:28:32.977145 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 11:28:33.560118 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 11:28:33.565544 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:33.576446 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:28:33.613041 tst emergency_mo_mt_call.py: using LAC 28078 11:28:33.740513 tst emergency_mo_mt_call.py: using RAC 28 11:28:33.865342 tst emergency_mo_mt_call.py: using CellId 28078 11:28:33.988261 tst emergency_mo_mt_call.py: using BVCI 28079 11:28:34.103877 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:34.114675 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:34.125488 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:34.136134 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:34.146861 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:34.157541 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:28:34.268777 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:28:34.386713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:34.880587 run create_hlr_db(pid=2220): Launched 11:28:35.010672 bus /sierra_2: Setting Powered False 11:28:36.074110 run create_hlr_db(pid=2220): Terminated: ok {rc=0} 11:28:36.499813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2222): Launched 11:28:36.798164 run osmo-hlr_10.42.42.2(pid=2223): Launched 11:28:36.912924 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:37.439495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2225): Launched 11:28:37.737098 run osmo-stp_10.42.42.5(pid=2226): Launched 11:28:37.860096 tst emergency_mo_mt_call.py: using MSISDN 7714 11:28:38.011470 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:38.544000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2228): Launched 11:28:38.841594 run osmo-msc_10.42.42.6(pid=2229): Launched 11:28:39.008247 run osmo-stp_10.42.42.5(pid=2226): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2226)] 11:28:39.134746 run osmo-stp_10.42.42.5(pid=2226): stdout: | (launched: 2022-12-10_11:28:37.683020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:39.261174 run osmo-stp_10.42.42.5(pid=2226): stderr: | 20221210112837850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112837850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112837850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112837851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112837851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112837851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112837851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:39.384706 run osmo-stp_10.42.42.5(pid=2226): stdout: | (launched: 2022-12-10_11:28:37.683020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:39.503610 run osmo-stp_10.42.42.5(pid=2226): stderr: | 20221210112837850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112837850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112837850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112837851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112837851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112837851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112837851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:39.645618 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2226): Process ended prematurely: osmo-stp_10.42.42.5(pid=2226) [trial-2374↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2226)] [trial-2374↪emergency:oc2g↪emergency_mo_mt_call.py:19] 11:28:39.653792 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 11:28:39.680118 run osmo-hlr_10.42.42.2(pid=2223): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2223)] 11:28:39.728449 run osmo-hlr_10.42.42.2(pid=2223): stdout: | (launched: 2022-12-10_11:28:36.743838) 11:28:39.777640 run osmo-hlr_10.42.42.2(pid=2223): stderr: | 20221210112836917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112836917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112836917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112836917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112836917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112836917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112836929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112836938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112836938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112836938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:39.846687 run osmo-msc_10.42.42.6(pid=2229): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2229)] 11:28:39.894362 run osmo-msc_10.42.42.6(pid=2229): stdout: | (launched: 2022-12-10_11:28:38.787091) 11:28:39.943563 run osmo-msc_10.42.42.6(pid=2229): stderr: | 20221210112839059 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112839059 DLGLOBAL DEBUG validating counter group 0x7f23343a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112839060 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112839060 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112839060 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112839060 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112839062 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112839062 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112839063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112839063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:39.993312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2222): Terminating (SIGTERM) 11:28:40.032857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2225): Terminating (SIGTERM) 11:28:40.072873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2228): Terminating (SIGTERM) 11:28:40.112942 --- ParallelTerminationStrategy: PID 2222 died... 11:28:40.131902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2222): Terminated: ok {rc=0} 11:28:40.176394 --- ParallelTerminationStrategy: PID 2225 died... 11:28:40.194881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2225): Terminated: ok {rc=0} 11:28:40.238953 --- ParallelTerminationStrategy: PID 2228 died... 11:28:40.257615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2228): Terminated: ok {rc=0} 11:28:40.343347 bus /sierra_3: Setting Powered False 11:28:41.442108 bus /sierra_3: Setting Powered False 11:28:42.558214 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 11:28:43.644454 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:43.655625 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:28:43.694406 tst emergency_preemptive_call.py: using LAC 28079 11:28:43.820055 tst emergency_preemptive_call.py: using RAC 29 11:28:43.945063 tst emergency_preemptive_call.py: using CellId 28079 11:28:44.069788 tst emergency_preemptive_call.py: using BVCI 28080 11:28:44.186489 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:44.197627 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:44.208581 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:44.219951 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:44.231285 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:28:44.242504 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:28:44.359092 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:28:44.476009 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:28:44.592119 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:28:44.706869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:45.169572 run create_hlr_db(pid=2231): Launched 11:28:45.283744 bus /sierra_2: Setting Powered False 11:28:46.346732 run create_hlr_db(pid=2231): Terminated: ok {rc=0} 11:28:46.865989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2233): Launched 11:28:47.182776 run osmo-hlr_10.42.42.2(pid=2234): Launched 11:28:47.317781 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:47.876129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2236): Launched 11:28:48.195722 run osmo-stp_10.42.42.5(pid=2237): Launched 11:28:48.328354 tst emergency_preemptive_call.py: using MSISDN 7715 11:28:48.493441 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:49.065707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2239): Launched 11:28:49.383189 run osmo-msc_10.42.42.6(pid=2240): Launched 11:28:49.560860 run osmo-stp_10.42.42.5(pid=2237): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2237)] 11:28:49.694311 run osmo-stp_10.42.42.5(pid=2237): stdout: | (launched: 2022-12-10_11:28:48.138041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:49.827673 run osmo-stp_10.42.42.5(pid=2237): stderr: | 20221210112848327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112848327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112848327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112848328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112848328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112848328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112848328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:49.961539 run osmo-stp_10.42.42.5(pid=2237): stdout: | (launched: 2022-12-10_11:28:48.138041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:50.089226 run osmo-stp_10.42.42.5(pid=2237): stderr: | 20221210112848327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112848327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112848327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112848328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112848328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112848328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112848328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:50.240861 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2237): Process ended prematurely: osmo-stp_10.42.42.5(pid=2237) [trial-2374↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2237)] [trial-2374↪emergency:oc2g↪emergency_preemptive_call.py:32] 11:28:50.250114 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 11:28:50.277649 run osmo-hlr_10.42.42.2(pid=2234): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2234)] 11:28:50.327161 run osmo-hlr_10.42.42.2(pid=2234): stdout: | (launched: 2022-12-10_11:28:47.117711) 11:28:50.378255 run osmo-hlr_10.42.42.2(pid=2234): stderr: | 20221210112847320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112847320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112847320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112847320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112847320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112847320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112847331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112847340 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112847341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112847341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:50.449689 run osmo-msc_10.42.42.6(pid=2240): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2240)] 11:28:50.499270 run osmo-msc_10.42.42.6(pid=2240): stdout: | (launched: 2022-12-10_11:28:49.325484) 11:28:50.550193 run osmo-msc_10.42.42.6(pid=2240): stderr: | 20221210112849646 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210112849646 DLGLOBAL DEBUG validating counter group 0x7f2ac41d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210112849646 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210112849646 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210112849647 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210112849647 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210112849649 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210112849649 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210112849649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210112849649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:50.601691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2233): Terminating (SIGTERM) 11:28:50.642754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2236): Terminating (SIGTERM) 11:28:50.683976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2239): Terminating (SIGTERM) 11:28:50.725538 --- ParallelTerminationStrategy: PID 2233 died... 11:28:50.745422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2233): Terminated: ok {rc=0} 11:28:50.791200 --- ParallelTerminationStrategy: PID 2236 died... 11:28:50.810421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2236): Terminated: ok {rc=0} 11:28:50.856647 --- ParallelTerminationStrategy: PID 2239 died... 11:28:50.876357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2239): Terminated: ok {rc=0} 11:28:50.964519 bus /sierra_9: Setting Powered False 11:28:52.062849 bus /sierra_9: Setting Powered False 11:28:53.178067 bus /sierra_8: Setting Powered False 11:28:54.276770 bus /sierra_8: Setting Powered False 11:28:55.394065 bus /sierra_3: Setting Powered False 11:28:56.491917 bus /sierra_3: Setting Powered False 11:28:57.608436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:oc2g --------------------------------------------------------------------- 11:28:58.873401 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:58.877916 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 11:28:58.898872 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 11:28:58.937794 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 11:28:59.026740 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 11:28:59.047700 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 11:28:59.086943 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 11:28:59.674996 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 11:28:59.727728 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:28:59.738685 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:28:59.773753 tst cs_paging_gprs_active.py: using LAC 28080 11:28:59.901328 tst cs_paging_gprs_active.py: using RAC 30 11:29:00.028268 tst cs_paging_gprs_active.py: using CellId 28080 11:29:00.155993 tst cs_paging_gprs_active.py: using BVCI 28081 11:29:00.274211 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.284924 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.295650 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.306888 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.317963 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.329089 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.340287 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.351540 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:00.363062 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:00.481297 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:00.601157 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:29:00.805475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:29:01.128085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2245): Launched 11:29:01.419876 run iperf3-srv_10.42.42.10(pid=2246): Launched 11:29:01.545616 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:29:01.756332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:29:02.071743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2247): Launched 11:29:02.377963 run iperf3-srv_10.42.42.10(pid=2248): Launched 11:29:02.500592 tst cs_paging_gprs_active.py:38: start network... 11:29:02.720185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:03.223469 run create_hlr_db(pid=2249): Launched 11:29:03.356138 bus /sierra_2: Setting Powered False 11:29:04.420118 run create_hlr_db(pid=2249): Terminated: ok {rc=0} 11:29:04.851464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Launched 11:29:05.155268 run osmo-hlr_10.42.42.2(pid=2252): Launched 11:29:05.271818 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:05.806574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Launched 11:29:06.109368 run osmo-stp_10.42.42.5(pid=2255): Launched 11:29:06.225823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:29:06.748815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2257): Launched 11:29:06.865842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:29:07.121909 run patchelf(pid=2258): Launched 11:29:07.290920 run osmo-stp_10.42.42.5(pid=2255): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] 11:29:07.419122 run osmo-stp_10.42.42.5(pid=2255): stdout: | (launched: 2022-12-10_11:29:06.054080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:07.549181 run osmo-stp_10.42.42.5(pid=2255): stderr: | 20221210112906225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112906226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112906226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112906226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112906227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112906227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112906227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:07.678888 run osmo-stp_10.42.42.5(pid=2255): stdout: | (launched: 2022-12-10_11:29:06.054080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:07.802613 run osmo-stp_10.42.42.5(pid=2255): stderr: | 20221210112906225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112906226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112906226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112906226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112906227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112906227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112906227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:07.949805 run patchelf(pid=2258): Terminating (SIGINT) 11:29:08.119946 run patchelf(pid=2258): Terminated: ok {rc=0} 11:29:08.242514 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2255): Process ended prematurely: osmo-stp_10.42.42.5(pid=2255) [trial-2374↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] [trial-2374↪gprs:oc2g↪cs_paging_gprs_active.py:38] 11:29:08.251785 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:29:08.279335 run osmo-hlr_10.42.42.2(pid=2252): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2252)] 11:29:08.326940 run osmo-hlr_10.42.42.2(pid=2252): stdout: | (launched: 2022-12-10_11:29:05.099959) 11:29:08.376479 run osmo-hlr_10.42.42.2(pid=2252): stderr: | 20221210112905275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112905275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112905275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112905275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112905275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112905275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112905288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112905298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112905298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112905298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:08.426529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2245): Terminating (SIGTERM) 11:29:08.466465 run iperf3-srv_10.42.42.10(pid=2246): Terminating (SIGTERM) 11:29:08.506411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2247): Terminating (SIGTERM) 11:29:08.546517 run iperf3-srv_10.42.42.10(pid=2248): Terminating (SIGTERM) 11:29:08.586099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Terminating (SIGTERM) 11:29:08.625649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Terminating (SIGTERM) 11:29:08.665337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2257): Terminating (SIGTERM) 11:29:08.705953 --- ParallelTerminationStrategy: PID 2245 died... 11:29:08.725130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2245): Terminated: ok {rc=0} 11:29:08.769634 --- ParallelTerminationStrategy: PID 2246 died... 11:29:08.788025 run iperf3-srv_10.42.42.10(pid=2246): Terminated {rc=256} 11:29:08.831910 --- ParallelTerminationStrategy: PID 2247 died... 11:29:08.850379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2247): Terminated: ok {rc=0} 11:29:08.895374 --- ParallelTerminationStrategy: PID 2248 died... 11:29:08.913918 run iperf3-srv_10.42.42.10(pid=2248): Terminated {rc=256} 11:29:08.958194 --- ParallelTerminationStrategy: PID 2251 died... 11:29:08.976664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Terminated: ok {rc=0} 11:29:09.020332 --- ParallelTerminationStrategy: PID 2254 died... 11:29:09.038914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Terminated: ok {rc=0} 11:29:09.083242 --- ParallelTerminationStrategy: PID 2257 died... 11:29:09.101898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2257): Terminated: ok {rc=0} 11:29:09.186373 bus /gobi_0: Setting Powered False 11:29:10.284682 bus /gobi_0: Setting Powered False 11:29:11.398864 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g iperf3.py ---------------------------------------------- 11:29:12.547840 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:12.559340 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:29:12.599334 tst iperf3.py: using LAC 28081 11:29:12.725374 tst iperf3.py: using RAC 31 11:29:12.850487 tst iperf3.py: using CellId 28081 11:29:12.976262 tst iperf3.py: using BVCI 28082 11:29:13.088247 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.098779 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.109000 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.119548 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.130040 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.140365 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.150940 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.161855 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:13.173446 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:13.290381 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:29:13.494670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:29:13.798364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2259): Launched 11:29:14.061228 run iperf3-srv_10.42.42.10(pid=2260): Launched 11:29:14.175271 tst iperf3.py:8: start network... 11:29:14.377960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:14.844801 run create_hlr_db(pid=2261): Launched 11:29:14.960692 bus /gobi_6: Setting Powered False 11:29:16.026349 run create_hlr_db(pid=2261): Terminated: ok {rc=0} 11:29:16.495443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2263): Launched 11:29:16.844550 run osmo-hlr_10.42.42.2(pid=2264): Launched 11:29:17.095965 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:17.713382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2266): Launched 11:29:18.037195 run osmo-stp_10.42.42.5(pid=2267): Launched 11:29:18.161729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:29:18.721750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2269): Launched 11:29:18.846383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:29:19.121330 run patchelf(pid=2270): Launched 11:29:19.301748 run osmo-stp_10.42.42.5(pid=2267): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2267)] 11:29:19.439108 run osmo-stp_10.42.42.5(pid=2267): stdout: | (launched: 2022-12-10_11:29:17.978479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:19.577801 run osmo-stp_10.42.42.5(pid=2267): stderr: | 20221210112918172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112918172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112918173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112918173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112918174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112918174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112918174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:19.716893 run osmo-stp_10.42.42.5(pid=2267): stdout: | (launched: 2022-12-10_11:29:17.978479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:19.850069 run osmo-stp_10.42.42.5(pid=2267): stderr: | 20221210112918172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112918172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112918173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112918173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112918174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112918174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112918174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:20.007639 run patchelf(pid=2270): Terminating (SIGINT) 11:29:20.190760 run patchelf(pid=2270): Terminated: ok {rc=0} 11:29:20.322011 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2267): Process ended prematurely: osmo-stp_10.42.42.5(pid=2267) [trial-2374↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2267)] [trial-2374↪gprs:oc2g↪iperf3.py:8] 11:29:20.332068 tst iperf3.py:8: Test FAILED (7.8 sec) 11:29:20.360573 run osmo-hlr_10.42.42.2(pid=2264): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2264)] 11:29:20.410676 run osmo-hlr_10.42.42.2(pid=2264): stdout: | (launched: 2022-12-10_11:29:16.777699) 11:29:20.462442 run osmo-hlr_10.42.42.2(pid=2264): stderr: | 20221210112917085 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112917085 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112917085 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112917085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112917085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112917085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112917104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112917113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112917113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112917113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:20.514755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2259): Terminating (SIGTERM) 11:29:20.556480 run iperf3-srv_10.42.42.10(pid=2260): Terminating (SIGTERM) 11:29:20.598144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2263): Terminating (SIGTERM) 11:29:20.639932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2266): Terminating (SIGTERM) 11:29:20.681754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2269): Terminating (SIGTERM) 11:29:20.723850 --- ParallelTerminationStrategy: PID 2259 died... 11:29:20.743896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2259): Terminated: ok {rc=0} 11:29:20.790442 --- ParallelTerminationStrategy: PID 2260 died... 11:29:20.809890 run iperf3-srv_10.42.42.10(pid=2260): Terminated {rc=256} 11:29:20.856000 --- ParallelTerminationStrategy: PID 2263 died... 11:29:20.875686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2263): Terminated: ok {rc=0} 11:29:20.921698 --- ParallelTerminationStrategy: PID 2266 died... 11:29:20.941399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2266): Terminated: ok {rc=0} 11:29:20.987615 --- ParallelTerminationStrategy: PID 2269 died... 11:29:21.007276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2269): Terminated: ok {rc=0} 11:29:21.095463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g iperf3m4.py ---------------------------------------------- 11:29:22.246098 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.257714 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:29:22.294555 tst iperf3m4.py: using LAC 28082 11:29:22.423107 tst iperf3m4.py: using RAC 32 11:29:22.551673 tst iperf3m4.py: using CellId 28082 11:29:22.678795 tst iperf3m4.py: using BVCI 28083 11:29:22.798029 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.808679 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.819424 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.830095 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.840546 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.851165 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.861833 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.872325 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:22.883118 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:23.000110 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:23.119165 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:23.237523 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:23.351730 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:29:23.556212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:29:23.861327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2271): Launched 11:29:24.126600 run iperf3-srv_10.42.42.10(pid=2272): Launched 11:29:24.241106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:29:24.444356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:29:24.747426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2273): Launched 11:29:25.011583 run iperf3-srv_10.42.42.10(pid=2274): Launched 11:29:25.126526 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:29:25.329721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:29:25.633714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2275): Launched 11:29:25.896757 run iperf3-srv_10.42.42.10(pid=2276): Launched 11:29:26.010741 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:29:26.213306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:29:26.516218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2277): Launched 11:29:26.779355 run iperf3-srv_10.42.42.10(pid=2278): Launched 11:29:26.893283 tst iperf3m4.py:8: start network... 11:29:27.096057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:27.562620 run create_hlr_db(pid=2279): Launched 11:29:27.679870 bus /gobi_6: Setting Powered False 11:29:28.740149 run create_hlr_db(pid=2279): Terminated: ok {rc=0} 11:29:29.162650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2281): Launched 11:29:29.465403 run osmo-hlr_10.42.42.2(pid=2282): Launched 11:29:29.581259 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:30.113947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2284): Launched 11:29:30.416676 run osmo-stp_10.42.42.5(pid=2285): Launched 11:29:30.533329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:29:31.084893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2287): Launched 11:29:31.258702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:29:31.589721 run patchelf(pid=2288): Launched 11:29:31.782790 run osmo-stp_10.42.42.5(pid=2285): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2285)] 11:29:31.923288 run osmo-stp_10.42.42.5(pid=2285): stdout: | (launched: 2022-12-10_11:29:30.361330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:32.067902 run osmo-stp_10.42.42.5(pid=2285): stderr: | 20221210112930531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112930532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112930532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112930532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112930533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112930533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112930533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:32.210617 run osmo-stp_10.42.42.5(pid=2285): stdout: | (launched: 2022-12-10_11:29:30.361330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:32.345513 run osmo-stp_10.42.42.5(pid=2285): stderr: | 20221210112930531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112930532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112930532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112930532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112930533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112930533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112930533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:32.503672 run patchelf(pid=2288): Terminating (SIGINT) 11:29:32.686305 run patchelf(pid=2288): Terminated: ok {rc=0} 11:29:32.817421 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2285): Process ended prematurely: osmo-stp_10.42.42.5(pid=2285) [trial-2374↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2285)] [trial-2374↪gprs:oc2g↪iperf3m4.py:8] 11:29:32.827710 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:29:32.856842 run osmo-hlr_10.42.42.2(pid=2282): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2282)] 11:29:32.907032 run osmo-hlr_10.42.42.2(pid=2282): stdout: | (launched: 2022-12-10_11:29:29.410035) 11:29:32.958979 run osmo-hlr_10.42.42.2(pid=2282): stderr: | 20221210112929589 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112929589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112929589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112929589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112929589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112929589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112929601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112929609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112929610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112929610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:33.011317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2271): Terminating (SIGTERM) 11:29:33.053584 run iperf3-srv_10.42.42.10(pid=2272): Terminating (SIGTERM) 11:29:33.095509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2273): Terminating (SIGTERM) 11:29:33.137664 run iperf3-srv_10.42.42.10(pid=2274): Terminating (SIGTERM) 11:29:33.179827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2275): Terminating (SIGTERM) 11:29:33.222068 run iperf3-srv_10.42.42.10(pid=2276): Terminating (SIGTERM) 11:29:33.264034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2277): Terminating (SIGTERM) 11:29:33.306182 run iperf3-srv_10.42.42.10(pid=2278): Terminating (SIGTERM) 11:29:33.348191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2281): Terminating (SIGTERM) 11:29:33.390289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2284): Terminating (SIGTERM) 11:29:33.432462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2287): Terminating (SIGTERM) 11:29:33.474835 --- ParallelTerminationStrategy: PID 2271 died... 11:29:33.494993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2271): Terminated: ok {rc=0} 11:29:33.541782 --- ParallelTerminationStrategy: PID 2272 died... 11:29:33.561654 run iperf3-srv_10.42.42.10(pid=2272): Terminated {rc=256} 11:29:33.608283 --- ParallelTerminationStrategy: PID 2273 died... 11:29:33.628102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2273): Terminated: ok {rc=0} 11:29:33.674514 --- ParallelTerminationStrategy: PID 2274 died... 11:29:33.694235 run iperf3-srv_10.42.42.10(pid=2274): Terminated {rc=256} 11:29:33.740662 --- ParallelTerminationStrategy: PID 2275 died... 11:29:33.760536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2275): Terminated: ok {rc=0} 11:29:33.807141 --- ParallelTerminationStrategy: PID 2276 died... 11:29:33.827080 run iperf3-srv_10.42.42.10(pid=2276): Terminated {rc=256} 11:29:33.873670 --- ParallelTerminationStrategy: PID 2277 died... 11:29:33.893546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2277): Terminated: ok {rc=0} 11:29:33.940011 --- ParallelTerminationStrategy: PID 2278 died... 11:29:33.959907 run iperf3-srv_10.42.42.10(pid=2278): Terminated {rc=256} 11:29:34.006801 --- ParallelTerminationStrategy: PID 2281 died... 11:29:34.026798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2281): Terminated: ok {rc=0} 11:29:34.073617 --- ParallelTerminationStrategy: PID 2284 died... 11:29:34.093782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2284): Terminated: ok {rc=0} 11:29:34.140261 --- ParallelTerminationStrategy: PID 2287 died... 11:29:34.160029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2287): Terminated: ok {rc=0} 11:29:34.248017 bus /gobi_4: Setting Powered False 11:29:35.347248 bus /gobi_4: Setting Powered False 11:29:36.463642 bus /gobi_1: Setting Powered False 11:29:37.562843 bus /gobi_1: Setting Powered False 11:29:38.678106 bus /gobi_0: Setting Powered False 11:29:39.773157 bus /gobi_0: Setting Powered False 11:29:40.889248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g ping.py ---------------------------------------------- 11:29:41.992114 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.003278 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:29:42.038817 tst ping.py: using LAC 28083 11:29:42.157089 tst ping.py: using RAC 33 11:29:42.275208 tst ping.py: using CellId 28083 11:29:42.393102 tst ping.py: using BVCI 28084 11:29:42.500608 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.511138 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.521511 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.532444 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.543067 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.553758 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.564569 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:42.575272 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:42.688510 tst ping.py:19: start network... 11:29:42.889441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:43.349329 run create_hlr_db(pid=2290): Launched 11:29:43.463078 bus /gobi_6: Setting Powered False 11:29:44.522955 run create_hlr_db(pid=2290): Terminated: ok {rc=0} 11:29:44.958656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2292): Launched 11:29:45.279282 run osmo-hlr_10.42.42.2(pid=2293): Launched 11:29:45.402582 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:45.973867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2295): Launched 11:29:46.310748 run osmo-stp_10.42.42.5(pid=2296): Launched 11:29:46.544884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:29:47.189759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2298): Launched 11:29:47.314972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:29:47.567377 run patchelf(pid=2299): Launched 11:29:47.733890 run osmo-stp_10.42.42.5(pid=2296): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2296)] 11:29:47.860094 run osmo-stp_10.42.42.5(pid=2296): stdout: | (launched: 2022-12-10_11:29:46.242066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:47.987557 run osmo-stp_10.42.42.5(pid=2296): stderr: | 20221210112946520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112946520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112946520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112946532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112946532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112946532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112946532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:48.115284 run osmo-stp_10.42.42.5(pid=2296): stdout: | (launched: 2022-12-10_11:29:46.242066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:48.237917 run osmo-stp_10.42.42.5(pid=2296): stderr: | 20221210112946520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112946520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112946520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112946532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112946532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112946532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112946532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:48.382735 run patchelf(pid=2299): Terminating (SIGINT) 11:29:48.550010 run patchelf(pid=2299): Terminated: ok {rc=0} 11:29:48.670228 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2296): Process ended prematurely: osmo-stp_10.42.42.5(pid=2296) [trial-2374↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2296)] [trial-2374↪gprs:oc2g↪ping.py:22] 11:29:48.679049 tst ping.py:22: Test FAILED (6.7 sec) 11:29:48.706861 run osmo-hlr_10.42.42.2(pid=2293): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2293)] 11:29:48.755197 run osmo-hlr_10.42.42.2(pid=2293): stdout: | (launched: 2022-12-10_11:29:45.220578) 11:29:48.805155 run osmo-hlr_10.42.42.2(pid=2293): stderr: | 20221210112945418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112945418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112945418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112945418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112945418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112945418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112945430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112945438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112945439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112945439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:48.855713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2292): Terminating (SIGTERM) 11:29:48.896102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2295): Terminating (SIGTERM) 11:29:48.936386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2298): Terminating (SIGTERM) 11:29:48.977252 --- ParallelTerminationStrategy: PID 2292 died... 11:29:48.996480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2292): Terminated: ok {rc=0} 11:29:49.041678 --- ParallelTerminationStrategy: PID 2295 died... 11:29:49.060391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2295): Terminated: ok {rc=0} 11:29:49.105358 --- ParallelTerminationStrategy: PID 2298 died... 11:29:49.123923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2298): Terminated: ok {rc=0} 11:29:49.210912 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 11:29:50.299760 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.310986 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:29:50.346895 tst ping_idle_ping.py: using LAC 28084 11:29:50.463247 tst ping_idle_ping.py: using RAC 34 11:29:50.589858 tst ping_idle_ping.py: using CellId 28084 11:29:50.715582 tst ping_idle_ping.py: using BVCI 28085 11:29:50.833336 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.844094 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.855099 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.866517 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.877854 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.889197 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.900459 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:29:50.911763 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:29:51.031438 tst ping_idle_ping.py:24: start network... 11:29:51.248456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:51.747269 run create_hlr_db(pid=2300): Launched 11:29:51.872791 bus /gobi_6: Setting Powered False 11:29:52.932692 run create_hlr_db(pid=2300): Terminated: ok {rc=0} 11:29:53.349042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2302): Launched 11:29:53.647290 run osmo-hlr_10.42.42.2(pid=2303): Launched 11:29:53.762730 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:54.289793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2305): Launched 11:29:54.588065 run osmo-stp_10.42.42.5(pid=2306): Launched 11:29:54.702714 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:29:55.216886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2308): Launched 11:29:55.331746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:29:55.584034 run patchelf(pid=2309): Launched 11:29:55.750974 run osmo-stp_10.42.42.5(pid=2306): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2306)] 11:29:55.877539 run osmo-stp_10.42.42.5(pid=2306): stdout: | (launched: 2022-12-10_11:29:54.533495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:56.005425 run osmo-stp_10.42.42.5(pid=2306): stderr: | 20221210112954702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112954702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112954702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112954703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112954703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112954703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112954703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:56.133782 run osmo-stp_10.42.42.5(pid=2306): stdout: | (launched: 2022-12-10_11:29:54.533495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:56.255921 run osmo-stp_10.42.42.5(pid=2306): stderr: | 20221210112954702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210112954702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210112954702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210112954703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210112954703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210112954703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210112954703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:56.401521 run patchelf(pid=2309): Terminating (SIGINT) 11:29:56.568629 run patchelf(pid=2309): Terminated: ok {rc=0} 11:29:56.689493 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2306): Process ended prematurely: osmo-stp_10.42.42.5(pid=2306) [trial-2374↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2306)] [trial-2374↪gprs:oc2g↪ping_idle_ping.py:27] 11:29:56.698198 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:29:56.725357 run osmo-hlr_10.42.42.2(pid=2303): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2303)] 11:29:56.773210 run osmo-hlr_10.42.42.2(pid=2303): stdout: | (launched: 2022-12-10_11:29:53.592796) 11:29:56.822429 run osmo-hlr_10.42.42.2(pid=2303): stderr: | 20221210112953767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210112953767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210112953767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210112953767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210112953768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210112953768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210112953781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210112953789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210112953789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210112953789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:56.871956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2302): Terminating (SIGTERM) 11:29:56.911897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2305): Terminating (SIGTERM) 11:29:56.951847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2308): Terminating (SIGTERM) 11:29:56.992094 --- ParallelTerminationStrategy: PID 2302 died... 11:29:57.011281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2302): Terminated: ok {rc=0} 11:29:57.055830 --- ParallelTerminationStrategy: PID 2305 died... 11:29:57.074497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2305): Terminated: ok {rc=0} 11:29:57.118953 --- ParallelTerminationStrategy: PID 2308 died... 11:29:57.137686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2308): Terminated: ok {rc=0} 11:29:57.220886 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 11:29:58.508169 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:58.513288 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:29:58.533955 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:29:58.572721 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:29:58.657846 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:29:58.677842 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:29:58.715639 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:29:59.305518 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:29:59.353930 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.364389 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:29:59.401105 tst cs_paging_gprs_active.py: using LAC 28085 11:29:59.527644 tst cs_paging_gprs_active.py: using RAC 35 11:29:59.653929 tst cs_paging_gprs_active.py: using CellId 28085 11:29:59.780479 tst cs_paging_gprs_active.py: using BVCI 28086 11:29:59.897621 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.908777 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.919804 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.931005 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.942106 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.952910 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.964029 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.974865 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:29:59.986001 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:00.101393 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:00.220015 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:30:00.437192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:30:00.757701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2313): Launched 11:30:01.056877 run iperf3-srv_10.42.42.10(pid=2314): Launched 11:30:01.178847 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:30:01.385506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:30:01.705715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2315): Launched 11:30:02.025780 run iperf3-srv_10.42.42.10(pid=2319): Launched 11:30:02.145723 tst cs_paging_gprs_active.py:38: start network... 11:30:02.352007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:02.817726 run create_hlr_db(pid=2320): Launched 11:30:02.949730 bus /gobi_6: Setting Powered False 11:30:04.012847 run create_hlr_db(pid=2320): Terminated: ok {rc=0} 11:30:04.440098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2322): Launched 11:30:04.739896 run osmo-hlr_10.42.42.2(pid=2323): Launched 11:30:04.854938 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:05.404939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2325): Launched 11:30:05.723744 run osmo-stp_10.42.42.5(pid=2326): Launched 11:30:05.844755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:30:06.391859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2328): Launched 11:30:06.514699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:30:06.782632 run patchelf(pid=2329): Launched 11:30:06.959582 run osmo-stp_10.42.42.5(pid=2326): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2326)] 11:30:07.094984 run osmo-stp_10.42.42.5(pid=2326): stdout: | (launched: 2022-12-10_11:30:05.666288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:07.231567 run osmo-stp_10.42.42.5(pid=2326): stderr: | 20221210113005856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113005857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113005857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113005857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113005859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113005860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113005860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:07.368036 run osmo-stp_10.42.42.5(pid=2326): stdout: | (launched: 2022-12-10_11:30:05.666288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:07.499255 run osmo-stp_10.42.42.5(pid=2326): stderr: | 20221210113005856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113005857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113005857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113005857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113005859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113005860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113005860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:07.654096 run patchelf(pid=2329): Terminating (SIGINT) 11:30:07.832085 run patchelf(pid=2329): Terminated: ok {rc=0} 11:30:07.960454 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2326): Process ended prematurely: osmo-stp_10.42.42.5(pid=2326) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2326)] [trial-2374↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:30:07.970658 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:30:07.998943 run osmo-hlr_10.42.42.2(pid=2323): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2323)] 11:30:08.049584 run osmo-hlr_10.42.42.2(pid=2323): stdout: | (launched: 2022-12-10_11:30:04.685678) 11:30:08.101762 run osmo-hlr_10.42.42.2(pid=2323): stderr: | 20221210113004858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113004859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113004859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113004859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113004859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113004859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113004870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113004879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113004879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113004879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:08.153979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2313): Terminating (SIGTERM) 11:30:08.195826 run iperf3-srv_10.42.42.10(pid=2314): Terminating (SIGTERM) 11:30:08.237707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2315): Terminating (SIGTERM) 11:30:08.279730 run iperf3-srv_10.42.42.10(pid=2319): Terminating (SIGTERM) 11:30:08.321470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2322): Terminating (SIGTERM) 11:30:08.363341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2325): Terminating (SIGTERM) 11:30:08.405169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2328): Terminating (SIGTERM) 11:30:08.447164 --- ParallelTerminationStrategy: PID 2313 died... 11:30:08.467093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2313): Terminated: ok {rc=0} 11:30:08.513949 --- ParallelTerminationStrategy: PID 2314 died... 11:30:08.533516 run iperf3-srv_10.42.42.10(pid=2314): Terminated {rc=256} 11:30:08.579494 --- ParallelTerminationStrategy: PID 2315 died... 11:30:08.598872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2315): Terminated: ok {rc=0} 11:30:08.645283 --- ParallelTerminationStrategy: PID 2319 died... 11:30:08.664750 run iperf3-srv_10.42.42.10(pid=2319): Terminated {rc=256} 11:30:08.710832 --- ParallelTerminationStrategy: PID 2322 died... 11:30:08.730285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2322): Terminated: ok {rc=0} 11:30:08.776703 --- ParallelTerminationStrategy: PID 2325 died... 11:30:08.796425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2325): Terminated: ok {rc=0} 11:30:08.842574 --- ParallelTerminationStrategy: PID 2328 died... 11:30:08.862151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2328): Terminated: ok {rc=0} 11:30:08.950244 bus /gobi_0: Setting Powered False 11:30:10.049850 bus /gobi_0: Setting Powered False 11:30:11.165655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:30:12.313431 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.325228 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:30:12.363122 tst iperf3.py: using LAC 28086 11:30:12.489096 tst iperf3.py: using RAC 36 11:30:12.613049 tst iperf3.py: using CellId 28086 11:30:12.736792 tst iperf3.py: using BVCI 28087 11:30:12.852071 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.863174 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.874160 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.885198 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.896083 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.907178 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.918324 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.929344 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:12.940436 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:13.059560 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:30:13.274170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:30:13.593086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2330): Launched 11:30:13.869074 run iperf3-srv_10.42.42.10(pid=2331): Launched 11:30:13.988635 tst iperf3.py:8: start network... 11:30:14.202919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:14.692386 run create_hlr_db(pid=2332): Launched 11:30:14.820889 bus /gobi_6: Setting Powered False 11:30:15.896628 run create_hlr_db(pid=2332): Terminated: ok {rc=0} 11:30:16.329585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Launched 11:30:16.646625 run osmo-hlr_10.42.42.2(pid=2335): Launched 11:30:16.885845 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:17.550829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Launched 11:30:17.869492 run osmo-stp_10.42.42.5(pid=2338): Launched 11:30:17.990811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:30:18.537464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2340): Launched 11:30:18.658502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:30:18.925722 run patchelf(pid=2341): Launched 11:30:19.102023 run osmo-stp_10.42.42.5(pid=2338): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] 11:30:19.236275 run osmo-stp_10.42.42.5(pid=2338): stdout: | (launched: 2022-12-10_11:30:17.812091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:19.372205 run osmo-stp_10.42.42.5(pid=2338): stderr: | 20221210113018003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113018003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113018004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113018004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113018004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113018004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113018005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:19.508727 run osmo-stp_10.42.42.5(pid=2338): stdout: | (launched: 2022-12-10_11:30:17.812091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:19.639169 run osmo-stp_10.42.42.5(pid=2338): stderr: | 20221210113018003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113018003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113018004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113018004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113018004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113018004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113018005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:19.793261 run patchelf(pid=2341): Terminating (SIGINT) 11:30:19.970905 run patchelf(pid=2341): Terminated: ok {rc=0} 11:30:20.099344 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2338): Process ended prematurely: osmo-stp_10.42.42.5(pid=2338) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 11:30:20.109377 tst iperf3.py:8: Test FAILED (7.8 sec) 11:30:20.137623 run osmo-hlr_10.42.42.2(pid=2335): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2335)] 11:30:20.187203 run osmo-hlr_10.42.42.2(pid=2335): stdout: | (launched: 2022-12-10_11:30:16.589349) 11:30:20.238251 run osmo-hlr_10.42.42.2(pid=2335): stderr: | 20221210113016928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113016928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113016928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113016928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113016929 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113016929 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113016955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113016972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113016972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113016972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:20.289658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2330): Terminating (SIGTERM) 11:30:20.331161 run iperf3-srv_10.42.42.10(pid=2331): Terminating (SIGTERM) 11:30:20.372735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Terminating (SIGTERM) 11:30:20.414749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Terminating (SIGTERM) 11:30:20.456342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2340): Terminating (SIGTERM) 11:30:20.498017 --- ParallelTerminationStrategy: PID 2330 died... 11:30:20.517810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2330): Terminated: ok {rc=0} 11:30:20.564277 --- ParallelTerminationStrategy: PID 2331 died... 11:30:20.583777 run iperf3-srv_10.42.42.10(pid=2331): Terminated {rc=256} 11:30:20.630417 --- ParallelTerminationStrategy: PID 2334 died... 11:30:20.650014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Terminated: ok {rc=0} 11:30:20.696412 --- ParallelTerminationStrategy: PID 2337 died... 11:30:20.715944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Terminated: ok {rc=0} 11:30:20.762396 --- ParallelTerminationStrategy: PID 2340 died... 11:30:20.782065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2340): Terminated: ok {rc=0} 11:30:20.870448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:30:22.021109 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.033007 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:30:22.070591 tst iperf3m4.py: using LAC 28087 11:30:22.196650 tst iperf3m4.py: using RAC 37 11:30:22.324908 tst iperf3m4.py: using CellId 28087 11:30:22.448595 tst iperf3m4.py: using BVCI 28088 11:30:22.563781 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.574810 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.585764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.596796 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.607620 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.618608 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.629828 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.640534 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:22.651598 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:22.769809 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:22.885341 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:23.000936 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:23.117350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:30:23.331271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:30:23.650974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2342): Launched 11:30:23.926679 run iperf3-srv_10.42.42.10(pid=2343): Launched 11:30:24.046529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:30:24.261499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:30:24.580233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2344): Launched 11:30:24.855995 run iperf3-srv_10.42.42.10(pid=2345): Launched 11:30:24.975106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:30:25.188845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:30:25.506895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2346): Launched 11:30:25.784023 run iperf3-srv_10.42.42.10(pid=2347): Launched 11:30:25.903517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:30:26.117918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:30:26.436700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2348): Launched 11:30:26.713509 run iperf3-srv_10.42.42.10(pid=2349): Launched 11:30:26.832566 tst iperf3m4.py:8: start network... 11:30:27.046331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:27.538599 run create_hlr_db(pid=2350): Launched 11:30:27.668919 bus /gobi_6: Setting Powered False 11:30:28.731931 run create_hlr_db(pid=2350): Terminated: ok {rc=0} 11:30:29.158121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Launched 11:30:29.455294 run osmo-hlr_10.42.42.2(pid=2353): Launched 11:30:29.569545 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:30.081257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Launched 11:30:30.379079 run osmo-stp_10.42.42.5(pid=2356): Launched 11:30:30.492611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:30:31.021735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2358): Launched 11:30:31.160008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:30:31.451615 run patchelf(pid=2359): Launched 11:30:31.644595 run osmo-stp_10.42.42.5(pid=2356): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2356)] 11:30:31.784145 run osmo-stp_10.42.42.5(pid=2356): stdout: | (launched: 2022-12-10_11:30:30.324446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:31.924486 run osmo-stp_10.42.42.5(pid=2356): stderr: | 20221210113030491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113030492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113030492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113030492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113030493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113030493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113030493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:32.065309 run osmo-stp_10.42.42.5(pid=2356): stdout: | (launched: 2022-12-10_11:30:30.324446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:32.199066 run osmo-stp_10.42.42.5(pid=2356): stderr: | 20221210113030491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113030492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113030492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113030492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113030493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113030493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113030493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:32.354371 run patchelf(pid=2359): Terminating (SIGINT) 11:30:32.533967 run patchelf(pid=2359): Terminated: ok {rc=0} 11:30:32.663054 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2356): Process ended prematurely: osmo-stp_10.42.42.5(pid=2356) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2356)] [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 11:30:32.673384 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:30:32.702443 run osmo-hlr_10.42.42.2(pid=2353): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2353)] 11:30:32.752689 run osmo-hlr_10.42.42.2(pid=2353): stdout: | (launched: 2022-12-10_11:30:29.400889) 11:30:32.804867 run osmo-hlr_10.42.42.2(pid=2353): stderr: | 20221210113029575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113029576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113029576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113029576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113029576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113029576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113029587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113029597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113029597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113029597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:32.857315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2342): Terminating (SIGTERM) 11:30:32.899464 run iperf3-srv_10.42.42.10(pid=2343): Terminating (SIGTERM) 11:30:32.941520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2344): Terminating (SIGTERM) 11:30:32.983731 run iperf3-srv_10.42.42.10(pid=2345): Terminating (SIGTERM) 11:30:33.025943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2346): Terminating (SIGTERM) 11:30:33.067931 run iperf3-srv_10.42.42.10(pid=2347): Terminating (SIGTERM) 11:30:33.110359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2348): Terminating (SIGTERM) 11:30:33.152624 run iperf3-srv_10.42.42.10(pid=2349): Terminating (SIGTERM) 11:30:33.194799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Terminating (SIGTERM) 11:30:33.237046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Terminating (SIGTERM) 11:30:33.279146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2358): Terminating (SIGTERM) 11:30:33.321830 --- ParallelTerminationStrategy: PID 2342 died... 11:30:33.341978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2342): Terminated: ok {rc=0} 11:30:33.388787 --- ParallelTerminationStrategy: PID 2343 died... 11:30:33.408565 run iperf3-srv_10.42.42.10(pid=2343): Terminated {rc=256} 11:30:33.455430 --- ParallelTerminationStrategy: PID 2344 died... 11:30:33.475230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2344): Terminated: ok {rc=0} 11:30:33.521683 --- ParallelTerminationStrategy: PID 2345 died... 11:30:33.541412 run iperf3-srv_10.42.42.10(pid=2345): Terminated {rc=256} 11:30:33.587484 --- ParallelTerminationStrategy: PID 2346 died... 11:30:33.607182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2346): Terminated: ok {rc=0} 11:30:33.653964 --- ParallelTerminationStrategy: PID 2347 died... 11:30:33.673502 run iperf3-srv_10.42.42.10(pid=2347): Terminated {rc=256} 11:30:33.719959 --- ParallelTerminationStrategy: PID 2348 died... 11:30:33.739845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2348): Terminated: ok {rc=0} 11:30:33.786589 --- ParallelTerminationStrategy: PID 2349 died... 11:30:33.806174 run iperf3-srv_10.42.42.10(pid=2349): Terminated {rc=256} 11:30:33.852261 --- ParallelTerminationStrategy: PID 2352 died... 11:30:33.871990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Terminated: ok {rc=0} 11:30:33.918130 --- ParallelTerminationStrategy: PID 2355 died... 11:30:33.937670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Terminated: ok {rc=0} 11:30:33.983862 --- ParallelTerminationStrategy: PID 2358 died... 11:30:34.003518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2358): Terminated: ok {rc=0} 11:30:34.091478 bus /gobi_4: Setting Powered False 11:30:35.191477 bus /gobi_4: Setting Powered False 11:30:36.306291 bus /gobi_1: Setting Powered False 11:30:37.403548 bus /gobi_1: Setting Powered False 11:30:38.518096 bus /gobi_0: Setting Powered False 11:30:39.615153 bus /gobi_0: Setting Powered False 11:30:40.728863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 11:30:41.831387 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:41.842983 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:30:41.881224 tst ping.py: using LAC 28088 11:30:42.008050 tst ping.py: using RAC 38 11:30:42.122729 tst ping.py: using CellId 28088 11:30:42.235717 tst ping.py: using BVCI 28089 11:30:42.341403 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:42.351986 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:42.362703 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:42.373809 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:42.384313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:42.395022 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:42.405819 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:42.416406 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:42.532545 tst ping.py:19: start network... 11:30:42.743179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:43.227216 run create_hlr_db(pid=2360): Launched 11:30:43.353858 bus /gobi_6: Setting Powered False 11:30:44.416263 run create_hlr_db(pid=2360): Terminated: ok {rc=0} 11:30:44.833754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2362): Launched 11:30:45.125518 run osmo-hlr_10.42.42.2(pid=2363): Launched 11:30:45.237563 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:45.742836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2365): Launched 11:30:46.074314 run osmo-stp_10.42.42.5(pid=2366): Launched 11:30:46.347795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:30:46.911822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2368): Launched 11:30:47.045504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:30:47.315436 run patchelf(pid=2369): Launched 11:30:47.489357 run osmo-stp_10.42.42.5(pid=2366): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2366)] 11:30:47.622288 run osmo-stp_10.42.42.5(pid=2366): stdout: | (launched: 2022-12-10_11:30:46.011460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:47.756397 run osmo-stp_10.42.42.5(pid=2366): stderr: | 20221210113046202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113046202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113046202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113046203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113046203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113046203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113046203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:47.890662 run osmo-stp_10.42.42.5(pid=2366): stdout: | (launched: 2022-12-10_11:30:46.011460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:48.018780 run osmo-stp_10.42.42.5(pid=2366): stderr: | 20221210113046202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113046202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113046202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113046203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113046203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113046203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113046203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:48.171566 run patchelf(pid=2369): Terminating (SIGINT) 11:30:48.346486 run patchelf(pid=2369): Terminated: ok {rc=0} 11:30:48.472295 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2366): Process ended prematurely: osmo-stp_10.42.42.5(pid=2366) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2366)] [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 11:30:48.481723 tst ping.py:22: Test FAILED (6.6 sec) 11:30:48.509480 run osmo-hlr_10.42.42.2(pid=2363): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2363)] 11:30:48.558905 run osmo-hlr_10.42.42.2(pid=2363): stdout: | (launched: 2022-12-10_11:30:45.072148) 11:30:48.610232 run osmo-hlr_10.42.42.2(pid=2363): stderr: | 20221210113045247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113045247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113045247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113045247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113045247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113045247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113045260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113045268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113045269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113045269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:48.661631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2362): Terminating (SIGTERM) 11:30:48.703030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2365): Terminating (SIGTERM) 11:30:48.744315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2368): Terminating (SIGTERM) 11:30:48.785941 --- ParallelTerminationStrategy: PID 2362 died... 11:30:48.805541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2362): Terminated: ok {rc=0} 11:30:48.851398 --- ParallelTerminationStrategy: PID 2365 died... 11:30:48.870685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2365): Terminated: ok {rc=0} 11:30:48.916233 --- ParallelTerminationStrategy: PID 2368 died... 11:30:48.935455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2368): Terminated: ok {rc=0} 11:30:49.022392 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:30:50.108401 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.119783 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:30:50.158655 tst ping_idle_ping.py: using LAC 28089 11:30:50.275870 tst ping_idle_ping.py: using RAC 39 11:30:50.391319 tst ping_idle_ping.py: using CellId 28089 11:30:50.508698 tst ping_idle_ping.py: using BVCI 28090 11:30:50.625358 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.636486 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.647498 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.658494 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.669385 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.680184 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.691253 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:30:50.702284 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:30:50.815128 tst ping_idle_ping.py:24: start network... 11:30:51.011339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:51.468578 run create_hlr_db(pid=2370): Launched 11:30:51.582706 bus /gobi_6: Setting Powered False 11:30:52.642194 run create_hlr_db(pid=2370): Terminated: ok {rc=0} 11:30:53.053110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Launched 11:30:53.346989 run osmo-hlr_10.42.42.2(pid=2373): Launched 11:30:53.460275 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:53.968751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Launched 11:30:54.261119 run osmo-stp_10.42.42.5(pid=2376): Launched 11:30:54.373853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:30:54.879348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2378): Launched 11:30:54.992230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:30:55.239309 run patchelf(pid=2379): Launched 11:30:55.402442 run osmo-stp_10.42.42.5(pid=2376): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] 11:30:55.526463 run osmo-stp_10.42.42.5(pid=2376): stdout: | (launched: 2022-12-10_11:30:54.207939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:55.652292 run osmo-stp_10.42.42.5(pid=2376): stderr: | 20221210113054376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113054376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113054376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113054377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113054377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113054377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113054378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:55.778653 run osmo-stp_10.42.42.5(pid=2376): stdout: | (launched: 2022-12-10_11:30:54.207939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:55.899711 run osmo-stp_10.42.42.5(pid=2376): stderr: | 20221210113054376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113054376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113054376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113054377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113054377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113054377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113054378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:56.042326 run patchelf(pid=2379): Terminating (SIGINT) 11:30:56.206749 run patchelf(pid=2379): Terminated: ok {rc=0} 11:30:56.325313 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2376): Process ended prematurely: osmo-stp_10.42.42.5(pid=2376) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 11:30:56.334076 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 11:30:56.360735 run osmo-hlr_10.42.42.2(pid=2373): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2373)] 11:30:56.408506 run osmo-hlr_10.42.42.2(pid=2373): stdout: | (launched: 2022-12-10_11:30:53.293241) 11:30:56.457441 run osmo-hlr_10.42.42.2(pid=2373): stderr: | 20221210113053469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113053469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113053469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113053469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113053469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113053469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113053481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113053490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113053490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113053490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:56.507050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Terminating (SIGTERM) 11:30:56.546848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Terminating (SIGTERM) 11:30:56.586511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2378): Terminating (SIGTERM) 11:30:56.626461 --- ParallelTerminationStrategy: PID 2372 died... 11:30:56.645404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Terminated: ok {rc=0} 11:30:56.689466 --- ParallelTerminationStrategy: PID 2375 died... 11:30:56.707939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Terminated: ok {rc=0} 11:30:56.752234 --- ParallelTerminationStrategy: PID 2378 died... 11:30:56.770935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2378): Terminated: ok {rc=0} 11:30:56.855649 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:30:58.150643 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:30:58.156725 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:30:58.177700 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:30:58.216824 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:30:58.306716 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:30:58.328028 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:30:58.365892 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:30:58.958614 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:30:59.009995 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.021033 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:30:59.077873 tst cs_paging_gprs_active.py: using LAC 28090 11:30:59.203890 tst cs_paging_gprs_active.py: using RAC 40 11:30:59.329223 tst cs_paging_gprs_active.py: using CellId 28090 11:30:59.456104 tst cs_paging_gprs_active.py: using BVCI 28091 11:30:59.571891 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.583159 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.594126 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.605186 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.616036 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.626982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.638031 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.648742 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:30:59.659873 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:30:59.775375 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:30:59.892088 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:31:00.093980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:00.393343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2385): Launched 11:31:00.653329 run iperf3-srv_10.42.42.10(pid=2386): Launched 11:31:00.766859 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:31:00.998798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:01.357809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2387): Launched 11:31:01.637909 run iperf3-srv_10.42.42.10(pid=2388): Launched 11:31:01.765131 tst cs_paging_gprs_active.py:38: start network... 11:31:01.973786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:02.443684 run create_hlr_db(pid=2389): Launched 11:31:02.559066 bus /gobi_6: Setting Powered False 11:31:03.618160 run create_hlr_db(pid=2389): Terminated: ok {rc=0} 11:31:04.034112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2391): Launched 11:31:04.332932 run osmo-hlr_10.42.42.2(pid=2392): Launched 11:31:04.447754 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:04.958869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2394): Launched 11:31:05.256886 run osmo-stp_10.42.42.5(pid=2395): Launched 11:31:05.371062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:05.890279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2397): Launched 11:31:06.005054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:06.257247 run patchelf(pid=2398): Launched 11:31:06.423429 run osmo-stp_10.42.42.5(pid=2395): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2395)] 11:31:06.550232 run osmo-stp_10.42.42.5(pid=2395): stdout: | (launched: 2022-12-10_11:31:05.202681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:06.678528 run osmo-stp_10.42.42.5(pid=2395): stderr: | 20221210113105372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113105373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113105373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113105373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113105374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113105374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113105374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:06.807095 run osmo-stp_10.42.42.5(pid=2395): stdout: | (launched: 2022-12-10_11:31:05.202681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:06.929707 run osmo-stp_10.42.42.5(pid=2395): stderr: | 20221210113105372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113105373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113105373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113105373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113105374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113105374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113105374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:07.074905 run patchelf(pid=2398): Terminating (SIGINT) 11:31:07.242923 run patchelf(pid=2398): Terminated: ok {rc=0} 11:31:07.363757 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2395): Process ended prematurely: osmo-stp_10.42.42.5(pid=2395) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2395)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:31:07.373111 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 11:31:07.400057 run osmo-hlr_10.42.42.2(pid=2392): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2392)] 11:31:07.447403 run osmo-hlr_10.42.42.2(pid=2392): stdout: | (launched: 2022-12-10_11:31:04.278480) 11:31:07.496346 run osmo-hlr_10.42.42.2(pid=2392): stderr: | 20221210113104456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113104456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113104456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113104456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113104456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113104457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113104468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113104477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113104477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113104477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:07.545736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2385): Terminating (SIGTERM) 11:31:07.585475 run iperf3-srv_10.42.42.10(pid=2386): Terminating (SIGTERM) 11:31:07.625032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2387): Terminating (SIGTERM) 11:31:07.664669 run iperf3-srv_10.42.42.10(pid=2388): Terminating (SIGTERM) 11:31:07.704121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2391): Terminating (SIGTERM) 11:31:07.743842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2394): Terminating (SIGTERM) 11:31:07.783881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2397): Terminating (SIGTERM) 11:31:07.823731 --- ParallelTerminationStrategy: PID 2385 died... 11:31:07.842579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2385): Terminated: ok {rc=0} 11:31:07.886823 --- ParallelTerminationStrategy: PID 2386 died... 11:31:07.905116 run iperf3-srv_10.42.42.10(pid=2386): Terminated {rc=256} 11:31:07.948582 --- ParallelTerminationStrategy: PID 2387 died... 11:31:07.966824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2387): Terminated: ok {rc=0} 11:31:08.010350 --- ParallelTerminationStrategy: PID 2388 died... 11:31:08.028494 run iperf3-srv_10.42.42.10(pid=2388): Terminated {rc=256} 11:31:08.071934 --- ParallelTerminationStrategy: PID 2391 died... 11:31:08.090312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2391): Terminated: ok {rc=0} 11:31:08.133890 --- ParallelTerminationStrategy: PID 2394 died... 11:31:08.152259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2394): Terminated: ok {rc=0} 11:31:08.196529 --- ParallelTerminationStrategy: PID 2397 died... 11:31:08.215148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2397): Terminated: ok {rc=0} 11:31:08.298120 bus /gobi_0: Setting Powered False 11:31:09.395609 bus /gobi_0: Setting Powered False 11:31:10.513393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:31:11.662401 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:11.674133 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:31:11.737272 tst iperf3.py: using LAC 28091 11:31:11.862154 tst iperf3.py: using RAC 41 11:31:11.986273 tst iperf3.py: using CellId 28091 11:31:12.113506 tst iperf3.py: using BVCI 28092 11:31:12.229149 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.240266 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.251227 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.262682 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.273531 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.284309 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.295380 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.306180 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:12.317262 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:31:12.432499 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:31:12.633245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:12.932545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2399): Launched 11:31:13.192924 run iperf3-srv_10.42.42.10(pid=2400): Launched 11:31:13.305286 tst iperf3.py:8: start network... 11:31:13.505891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:13.967841 run create_hlr_db(pid=2401): Launched 11:31:14.082590 bus /gobi_6: Setting Powered False 11:31:15.142087 run create_hlr_db(pid=2401): Terminated: ok {rc=0} 11:31:15.557730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2403): Launched 11:31:15.856775 run osmo-hlr_10.42.42.2(pid=2404): Launched 11:31:16.088448 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:16.782644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2406): Launched 11:31:17.119391 run osmo-stp_10.42.42.5(pid=2407): Launched 11:31:17.296359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:17.873489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2409): Launched 11:31:17.996810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:18.266778 run patchelf(pid=2410): Launched 11:31:18.444595 run osmo-stp_10.42.42.5(pid=2407): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2407)] 11:31:18.579820 run osmo-stp_10.42.42.5(pid=2407): stdout: | (launched: 2022-12-10_11:31:17.056076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:18.717193 run osmo-stp_10.42.42.5(pid=2407): stderr: | 20221210113117393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113117394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113117394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113117394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113117395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113117395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113117395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:18.854510 run osmo-stp_10.42.42.5(pid=2407): stdout: | (launched: 2022-12-10_11:31:17.056076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:18.985185 run osmo-stp_10.42.42.5(pid=2407): stderr: | 20221210113117393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113117394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113117394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113117394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113117395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113117395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113117395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:19.140873 run patchelf(pid=2410): Terminating (SIGINT) 11:31:19.319811 run patchelf(pid=2410): Terminated: ok {rc=0} 11:31:19.448719 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2407): Process ended prematurely: osmo-stp_10.42.42.5(pid=2407) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2407)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 11:31:19.458721 tst iperf3.py:8: Test FAILED (7.8 sec) 11:31:19.486799 run osmo-hlr_10.42.42.2(pid=2404): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2404)] 11:31:19.536115 run osmo-hlr_10.42.42.2(pid=2404): stdout: | (launched: 2022-12-10_11:31:15.801260) 11:31:19.587048 run osmo-hlr_10.42.42.2(pid=2404): stderr: | 20221210113116124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113116124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113116124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113116124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113116124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113116124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113116144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113116167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113116168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113116168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:19.638564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2399): Terminating (SIGTERM) 11:31:19.679883 run iperf3-srv_10.42.42.10(pid=2400): Terminating (SIGTERM) 11:31:19.721301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2403): Terminating (SIGTERM) 11:31:19.762382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2406): Terminating (SIGTERM) 11:31:19.803489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2409): Terminating (SIGTERM) 11:31:19.844651 --- ParallelTerminationStrategy: PID 2399 died... 11:31:19.864266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2399): Terminated: ok {rc=0} 11:31:19.910130 --- ParallelTerminationStrategy: PID 2400 died... 11:31:19.929321 run iperf3-srv_10.42.42.10(pid=2400): Terminated {rc=256} 11:31:19.974941 --- ParallelTerminationStrategy: PID 2403 died... 11:31:19.994370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2403): Terminated: ok {rc=0} 11:31:20.040161 --- ParallelTerminationStrategy: PID 2406 died... 11:31:20.059549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2406): Terminated: ok {rc=0} 11:31:20.105526 --- ParallelTerminationStrategy: PID 2409 died... 11:31:20.124670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2409): Terminated: ok {rc=0} 11:31:20.212203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:31:21.362095 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.373733 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:31:21.431429 tst iperf3m4.py: using LAC 28092 11:31:21.557295 tst iperf3m4.py: using RAC 42 11:31:21.681360 tst iperf3m4.py: using CellId 28092 11:31:21.799187 tst iperf3m4.py: using BVCI 28093 11:31:21.907268 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.918212 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.928800 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.940031 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.951211 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.962312 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.973421 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.984036 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:21.995438 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:31:22.110605 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:31:22.228526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:31:22.342229 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:31:22.456188 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:31:22.657128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:22.956559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2411): Launched 11:31:23.217676 run iperf3-srv_10.42.42.10(pid=2412): Launched 11:31:23.330320 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:31:23.530522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:23.829309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2413): Launched 11:31:24.089775 run iperf3-srv_10.42.42.10(pid=2414): Launched 11:31:24.202621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:31:24.402657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:24.701213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2415): Launched 11:31:24.960717 run iperf3-srv_10.42.42.10(pid=2416): Launched 11:31:25.072675 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:31:25.272054 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:25.570149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2417): Launched 11:31:25.829240 run iperf3-srv_10.42.42.10(pid=2418): Launched 11:31:25.941196 tst iperf3m4.py:8: start network... 11:31:26.141792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:26.601488 run create_hlr_db(pid=2419): Launched 11:31:26.715573 bus /gobi_6: Setting Powered False 11:31:27.781048 run create_hlr_db(pid=2419): Terminated: ok {rc=0} 11:31:28.199207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2421): Launched 11:31:28.497508 run osmo-hlr_10.42.42.2(pid=2422): Launched 11:31:28.612404 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:29.163345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2424): Launched 11:31:29.482440 run osmo-stp_10.42.42.5(pid=2425): Launched 11:31:29.605200 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:30.156847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2427): Launched 11:31:30.279281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:30.549678 run patchelf(pid=2428): Launched 11:31:30.728590 run osmo-stp_10.42.42.5(pid=2425): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2425)] 11:31:30.865630 run osmo-stp_10.42.42.5(pid=2425): stdout: | (launched: 2022-12-10_11:31:29.424545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:31.010211 run osmo-stp_10.42.42.5(pid=2425): stderr: | 20221210113129615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113129615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113129615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113129616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113129616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113129616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113129616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:31.149932 run osmo-stp_10.42.42.5(pid=2425): stdout: | (launched: 2022-12-10_11:31:29.424545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:31.283428 run osmo-stp_10.42.42.5(pid=2425): stderr: | 20221210113129615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113129615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113129615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113129616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113129616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113129616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113129616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:31.442483 run patchelf(pid=2428): Terminating (SIGINT) 11:31:31.626168 run patchelf(pid=2428): Terminated: ok {rc=0} 11:31:31.765432 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2425): Process ended prematurely: osmo-stp_10.42.42.5(pid=2425) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2425)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:31:31.779127 tst iperf3m4.py:8: Test FAILED (10.5 sec) 11:31:31.812425 run osmo-hlr_10.42.42.2(pid=2422): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2422)] 11:31:31.869571 run osmo-hlr_10.42.42.2(pid=2422): stdout: | (launched: 2022-12-10_11:31:28.443144) 11:31:31.923381 run osmo-hlr_10.42.42.2(pid=2422): stderr: | 20221210113128618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113128618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113128619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113128619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113128619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113128619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113128633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113128642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113128642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113128642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:31.977248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2411): Terminating (SIGTERM) 11:31:32.020924 run iperf3-srv_10.42.42.10(pid=2412): Terminating (SIGTERM) 11:31:32.067092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2413): Terminating (SIGTERM) 11:31:32.111102 run iperf3-srv_10.42.42.10(pid=2414): Terminating (SIGTERM) 11:31:32.156550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2415): Terminating (SIGTERM) 11:31:32.200274 run iperf3-srv_10.42.42.10(pid=2416): Terminating (SIGTERM) 11:31:32.245741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2417): Terminating (SIGTERM) 11:31:32.289823 run iperf3-srv_10.42.42.10(pid=2418): Terminating (SIGTERM) 11:31:32.331156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2421): Terminating (SIGTERM) 11:31:32.372428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2424): Terminating (SIGTERM) 11:31:32.413756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2427): Terminating (SIGTERM) 11:31:32.455258 --- ParallelTerminationStrategy: PID 2411 died... 11:31:32.474648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2411): Terminated: ok {rc=0} 11:31:32.520644 --- ParallelTerminationStrategy: PID 2412 died... 11:31:32.540017 run iperf3-srv_10.42.42.10(pid=2412): Terminated {rc=256} 11:31:32.585890 --- ParallelTerminationStrategy: PID 2413 died... 11:31:32.605296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2413): Terminated: ok {rc=0} 11:31:32.651135 --- ParallelTerminationStrategy: PID 2414 died... 11:31:32.670549 run iperf3-srv_10.42.42.10(pid=2414): Terminated {rc=256} 11:31:32.716290 --- ParallelTerminationStrategy: PID 2415 died... 11:31:32.735682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2415): Terminated: ok {rc=0} 11:31:32.781342 --- ParallelTerminationStrategy: PID 2416 died... 11:31:32.800570 run iperf3-srv_10.42.42.10(pid=2416): Terminated {rc=256} 11:31:32.846163 --- ParallelTerminationStrategy: PID 2417 died... 11:31:32.865398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2417): Terminated: ok {rc=0} 11:31:32.911690 --- ParallelTerminationStrategy: PID 2418 died... 11:31:32.931058 run iperf3-srv_10.42.42.10(pid=2418): Terminated {rc=256} 11:31:32.976525 --- ParallelTerminationStrategy: PID 2421 died... 11:31:32.995865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2421): Terminated: ok {rc=0} 11:31:33.041397 --- ParallelTerminationStrategy: PID 2424 died... 11:31:33.060701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2424): Terminated: ok {rc=0} 11:31:33.106704 --- ParallelTerminationStrategy: PID 2427 died... 11:31:33.126088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2427): Terminated: ok {rc=0} 11:31:33.213452 bus /gobi_4: Setting Powered False 11:31:34.313558 bus /gobi_4: Setting Powered False 11:31:35.428404 bus /gobi_1: Setting Powered False 11:31:36.527039 bus /gobi_1: Setting Powered False 11:31:37.645532 bus /gobi_0: Setting Powered False 11:31:38.744294 bus /gobi_0: Setting Powered False 11:31:39.861392 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:31:40.963864 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:40.975638 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:31:41.032913 tst ping.py: using LAC 28093 11:31:41.157948 tst ping.py: using RAC 43 11:31:41.285456 tst ping.py: using CellId 28093 11:31:41.408287 tst ping.py: using BVCI 28094 11:31:41.522366 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:41.533640 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:41.544702 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:41.555730 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:41.566644 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:41.577573 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:41.588605 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:41.599618 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:31:41.715908 tst ping.py:19: start network... 11:31:41.927198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:42.415059 run create_hlr_db(pid=2429): Launched 11:31:42.543240 bus /gobi_6: Setting Powered False 11:31:43.605971 run create_hlr_db(pid=2429): Terminated: ok {rc=0} 11:31:44.044292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2431): Launched 11:31:44.359495 run osmo-hlr_10.42.42.2(pid=2432): Launched 11:31:44.480360 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:45.029477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2434): Launched 11:31:45.342388 run osmo-stp_10.42.42.5(pid=2435): Launched 11:31:45.461981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:46.018947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2437): Launched 11:31:46.182189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:46.503646 run patchelf(pid=2438): Launched 11:31:46.681316 run osmo-stp_10.42.42.5(pid=2435): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2435)] 11:31:46.810692 run osmo-stp_10.42.42.5(pid=2435): stdout: | (launched: 2022-12-10_11:31:45.285692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:46.941528 run osmo-stp_10.42.42.5(pid=2435): stderr: | 20221210113145479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113145479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113145479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113145479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113145480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113145480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113145480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:47.073445 run osmo-stp_10.42.42.5(pid=2435): stdout: | (launched: 2022-12-10_11:31:45.285692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:47.199067 run osmo-stp_10.42.42.5(pid=2435): stderr: | 20221210113145479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113145479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113145479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113145479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113145480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113145480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113145480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:47.345794 run patchelf(pid=2438): Terminating (SIGINT) 11:31:47.510909 run patchelf(pid=2438): Terminated: ok {rc=0} 11:31:47.630964 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2435): Process ended prematurely: osmo-stp_10.42.42.5(pid=2435) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2435)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 11:31:47.639848 tst ping.py:22: Test FAILED (6.7 sec) 11:31:47.667408 run osmo-hlr_10.42.42.2(pid=2432): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2432)] 11:31:47.715852 run osmo-hlr_10.42.42.2(pid=2432): stdout: | (launched: 2022-12-10_11:31:44.302440) 11:31:47.765829 run osmo-hlr_10.42.42.2(pid=2432): stderr: | 20221210113144502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113144502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113144502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113144502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113144502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113144502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113144515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113144523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113144523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113144523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:47.816310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2431): Terminating (SIGTERM) 11:31:47.856701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2434): Terminating (SIGTERM) 11:31:47.897121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2437): Terminating (SIGTERM) 11:31:47.937989 --- ParallelTerminationStrategy: PID 2431 died... 11:31:47.957304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2431): Terminated: ok {rc=0} 11:31:48.002543 --- ParallelTerminationStrategy: PID 2434 died... 11:31:48.021388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2434): Terminated: ok {rc=0} 11:31:48.066236 --- ParallelTerminationStrategy: PID 2437 died... 11:31:48.085126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2437): Terminated: ok {rc=0} 11:31:48.172178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:31:49.261997 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.273910 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:31:49.330760 tst ping_idle_ping.py: using LAC 28094 11:31:49.449261 tst ping_idle_ping.py: using RAC 44 11:31:49.564611 tst ping_idle_ping.py: using CellId 28094 11:31:49.683275 tst ping_idle_ping.py: using BVCI 28095 11:31:49.791407 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.802360 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.812886 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.823781 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.834531 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.845285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.856179 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:31:49.866951 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:31:49.983736 tst ping_idle_ping.py:24: start network... 11:31:50.197561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:50.688562 run create_hlr_db(pid=2439): Launched 11:31:50.816442 bus /gobi_6: Setting Powered False 11:31:51.875840 run create_hlr_db(pid=2439): Terminated: ok {rc=0} 11:31:52.292552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2441): Launched 11:31:52.586342 run osmo-hlr_10.42.42.2(pid=2442): Launched 11:31:52.698163 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:53.203485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2444): Launched 11:31:53.498042 run osmo-stp_10.42.42.5(pid=2445): Launched 11:31:53.610270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:54.118315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2447): Launched 11:31:54.230576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:54.479493 run patchelf(pid=2448): Launched 11:31:54.643430 run osmo-stp_10.42.42.5(pid=2445): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2445)] 11:31:54.768221 run osmo-stp_10.42.42.5(pid=2445): stdout: | (launched: 2022-12-10_11:31:53.444288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:54.894773 run osmo-stp_10.42.42.5(pid=2445): stderr: | 20221210113153614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113153614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113153615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113153615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113153615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113153616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113153616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:55.021210 run osmo-stp_10.42.42.5(pid=2445): stdout: | (launched: 2022-12-10_11:31:53.444288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:55.141636 run osmo-stp_10.42.42.5(pid=2445): stderr: | 20221210113153614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113153614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113153615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113153615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113153615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113153616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113153616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:55.284754 run patchelf(pid=2448): Terminating (SIGINT) 11:31:55.450077 run patchelf(pid=2448): Terminated: ok {rc=0} 11:31:55.569367 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2445): Process ended prematurely: osmo-stp_10.42.42.5(pid=2445) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2445)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:31:55.578157 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 11:31:55.605165 run osmo-hlr_10.42.42.2(pid=2442): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2442)] 11:31:55.652550 run osmo-hlr_10.42.42.2(pid=2442): stdout: | (launched: 2022-12-10_11:31:52.532864) 11:31:55.701737 run osmo-hlr_10.42.42.2(pid=2442): stderr: | 20221210113152709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113152709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113152709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113152709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113152709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113152709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113152721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113152729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113152730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113152730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:55.751356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2441): Terminating (SIGTERM) 11:31:55.790771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2444): Terminating (SIGTERM) 11:31:55.830366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2447): Terminating (SIGTERM) 11:31:55.870236 --- ParallelTerminationStrategy: PID 2441 died... 11:31:55.889114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2441): Terminated: ok {rc=0} 11:31:55.933241 --- ParallelTerminationStrategy: PID 2444 died... 11:31:55.951513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2444): Terminated: ok {rc=0} 11:31:55.995451 --- ParallelTerminationStrategy: PID 2447 died... 11:31:56.013929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2447): Terminated: ok {rc=0} 11:31:56.097811 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:31:57.382658 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:31:57.388523 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:31:57.409133 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:31:57.446948 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:31:57.532240 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:31:57.552285 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:31:57.589972 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:31:58.182540 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:31:58.231112 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.241749 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:31:58.297434 tst cs_paging_gprs_active.py: using LAC 28095 11:31:58.416431 tst cs_paging_gprs_active.py: using RAC 45 11:31:58.533153 tst cs_paging_gprs_active.py: using CellId 28095 11:31:58.651319 tst cs_paging_gprs_active.py: using BVCI 28096 11:31:58.760705 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.771395 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.781845 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.792437 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.803145 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.813895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.824591 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.835323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:31:58.846081 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:31:58.962918 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:31:59.081677 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:31:59.299995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:59.621419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2453): Launched 11:31:59.899615 run iperf3-srv_10.42.42.10(pid=2454): Launched 11:32:00.019590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:32:00.236006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:00.557525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2455): Launched 11:32:00.838037 run iperf3-srv_10.42.42.10(pid=2456): Launched 11:32:00.970598 tst cs_paging_gprs_active.py:38: start network... 11:32:01.207688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:01.693251 run create_hlr_db(pid=2457): Launched 11:32:01.843794 bus /gobi_6: Setting Powered False 11:32:02.903279 run create_hlr_db(pid=2457): Terminated: ok {rc=0} 11:32:03.340909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2459): Launched 11:32:03.660274 run osmo-hlr_10.42.42.2(pid=2460): Launched 11:32:03.783682 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:04.337540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2462): Launched 11:32:04.657214 run osmo-stp_10.42.42.5(pid=2463): Launched 11:32:04.780671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:05.333521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2465): Launched 11:32:05.456421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:05.726502 run patchelf(pid=2466): Launched 11:32:05.905568 run osmo-stp_10.42.42.5(pid=2463): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2463)] 11:32:06.041649 run osmo-stp_10.42.42.5(pid=2463): stdout: | (launched: 2022-12-10_11:32:04.599524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:06.179843 run osmo-stp_10.42.42.5(pid=2463): stderr: | 20221210113204791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113204791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113204792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113204792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113204793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113204793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113204793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:06.317632 run osmo-stp_10.42.42.5(pid=2463): stdout: | (launched: 2022-12-10_11:32:04.599524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:06.449644 run osmo-stp_10.42.42.5(pid=2463): stderr: | 20221210113204791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113204791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113204792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113204792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113204793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113204793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113204793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:06.605572 run patchelf(pid=2466): Terminating (SIGINT) 11:32:06.784165 run patchelf(pid=2466): Terminated: ok {rc=0} 11:32:06.913086 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2463): Process ended prematurely: osmo-stp_10.42.42.5(pid=2463) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2463)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:32:06.923116 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:32:06.951143 run osmo-hlr_10.42.42.2(pid=2460): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2460)] 11:32:07.000708 run osmo-hlr_10.42.42.2(pid=2460): stdout: | (launched: 2022-12-10_11:32:03.602440) 11:32:07.051921 run osmo-hlr_10.42.42.2(pid=2460): stderr: | 20221210113203800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113203800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113203800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113203800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113203800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113203800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113203812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113203820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113203820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113203820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:07.103553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2453): Terminating (SIGTERM) 11:32:07.145191 run iperf3-srv_10.42.42.10(pid=2454): Terminating (SIGTERM) 11:32:07.186640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2455): Terminating (SIGTERM) 11:32:07.227946 run iperf3-srv_10.42.42.10(pid=2456): Terminating (SIGTERM) 11:32:07.269128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2459): Terminating (SIGTERM) 11:32:07.310439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2462): Terminating (SIGTERM) 11:32:07.351795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2465): Terminating (SIGTERM) 11:32:07.393271 --- ParallelTerminationStrategy: PID 2453 died... 11:32:07.413037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2453): Terminated: ok {rc=0} 11:32:07.458691 --- ParallelTerminationStrategy: PID 2454 died... 11:32:07.477940 run iperf3-srv_10.42.42.10(pid=2454): Terminated {rc=256} 11:32:07.523293 --- ParallelTerminationStrategy: PID 2455 died... 11:32:07.542465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2455): Terminated: ok {rc=0} 11:32:07.587925 --- ParallelTerminationStrategy: PID 2456 died... 11:32:07.607081 run iperf3-srv_10.42.42.10(pid=2456): Terminated {rc=256} 11:32:07.652485 --- ParallelTerminationStrategy: PID 2459 died... 11:32:07.671770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2459): Terminated: ok {rc=0} 11:32:07.717113 --- ParallelTerminationStrategy: PID 2462 died... 11:32:07.736274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2462): Terminated: ok {rc=0} 11:32:07.781626 --- ParallelTerminationStrategy: PID 2465 died... 11:32:07.800795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2465): Terminated: ok {rc=0} 11:32:07.887864 bus /gobi_0: Setting Powered False 11:32:08.987139 bus /gobi_0: Setting Powered False 11:32:10.104373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:32:11.248893 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.260431 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:32:11.318941 tst iperf3.py: using LAC 28096 11:32:11.438296 tst iperf3.py: using RAC 46 11:32:11.555046 tst iperf3.py: using CellId 28096 11:32:11.673603 tst iperf3.py: using BVCI 28097 11:32:11.781728 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.792415 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.802918 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.813694 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.824454 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.835095 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.845910 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.856441 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:11.867206 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:32:11.979815 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:32:12.180478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:12.479760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2467): Launched 11:32:12.739437 run iperf3-srv_10.42.42.10(pid=2468): Launched 11:32:12.851441 tst iperf3.py:8: start network... 11:32:13.050320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:13.510884 run create_hlr_db(pid=2469): Launched 11:32:13.625596 bus /gobi_6: Setting Powered False 11:32:14.685397 run create_hlr_db(pid=2469): Terminated: ok {rc=0} 11:32:15.123109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2471): Launched 11:32:15.443540 run osmo-hlr_10.42.42.2(pid=2472): Launched 11:32:15.566232 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:16.158244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2474): Launched 11:32:16.490310 run osmo-stp_10.42.42.5(pid=2475): Launched 11:32:16.744319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:17.436850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2477): Launched 11:32:17.552163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:17.804578 run patchelf(pid=2478): Launched 11:32:17.972075 run osmo-stp_10.42.42.5(pid=2475): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2475)] 11:32:18.098640 run osmo-stp_10.42.42.5(pid=2475): stdout: | (launched: 2022-12-10_11:32:16.428678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:18.226894 run osmo-stp_10.42.42.5(pid=2475): stderr: | 20221210113216668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113216668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113216668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113216669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113216669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113216669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113216669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:18.355412 run osmo-stp_10.42.42.5(pid=2475): stdout: | (launched: 2022-12-10_11:32:16.428678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:18.478257 run osmo-stp_10.42.42.5(pid=2475): stderr: | 20221210113216668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113216668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113216668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113216669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113216669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113216669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113216669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:18.623649 run patchelf(pid=2478): Terminating (SIGINT) 11:32:18.791185 run patchelf(pid=2478): Terminated: ok {rc=0} 11:32:18.912668 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2475): Process ended prematurely: osmo-stp_10.42.42.5(pid=2475) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2475)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 11:32:18.922219 tst iperf3.py:8: Test FAILED (7.7 sec) 11:32:18.949324 run osmo-hlr_10.42.42.2(pid=2472): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2472)] 11:32:18.997091 run osmo-hlr_10.42.42.2(pid=2472): stdout: | (launched: 2022-12-10_11:32:15.385876) 11:32:19.046234 run osmo-hlr_10.42.42.2(pid=2472): stderr: | 20221210113215583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113215583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113215583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113215583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113215583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113215583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113215595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113215603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113215603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113215603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:19.095822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2467): Terminating (SIGTERM) 11:32:19.135390 run iperf3-srv_10.42.42.10(pid=2468): Terminating (SIGTERM) 11:32:19.174916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2471): Terminating (SIGTERM) 11:32:19.214646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2474): Terminating (SIGTERM) 11:32:19.254561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2477): Terminating (SIGTERM) 11:32:19.294380 --- ParallelTerminationStrategy: PID 2467 died... 11:32:19.313270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2467): Terminated: ok {rc=0} 11:32:19.357556 --- ParallelTerminationStrategy: PID 2468 died... 11:32:19.375969 run iperf3-srv_10.42.42.10(pid=2468): Terminated {rc=256} 11:32:19.419842 --- ParallelTerminationStrategy: PID 2471 died... 11:32:19.438394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2471): Terminated: ok {rc=0} 11:32:19.482138 --- ParallelTerminationStrategy: PID 2474 died... 11:32:19.500417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2474): Terminated: ok {rc=0} 11:32:19.544861 --- ParallelTerminationStrategy: PID 2477 died... 11:32:19.563678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2477): Terminated: ok {rc=0} 11:32:19.647018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:32:20.795535 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:20.807312 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:32:20.869654 tst iperf3m4.py: using LAC 28097 11:32:20.994633 tst iperf3m4.py: using RAC 47 11:32:21.119933 tst iperf3m4.py: using CellId 28097 11:32:21.246139 tst iperf3m4.py: using BVCI 28098 11:32:21.362602 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.373862 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.385188 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.396649 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.408151 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.419685 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.431263 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.442655 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:21.454216 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:32:21.574338 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:32:21.694545 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:32:21.808159 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:32:21.923148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:32:22.125276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:22.426547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2479): Launched 11:32:22.687506 run iperf3-srv_10.42.42.10(pid=2480): Launched 11:32:22.800671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:32:23.002148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:23.302614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2481): Launched 11:32:23.562936 run iperf3-srv_10.42.42.10(pid=2482): Launched 11:32:23.675975 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:32:23.877367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:24.178499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2483): Launched 11:32:24.438887 run iperf3-srv_10.42.42.10(pid=2484): Launched 11:32:24.551805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:32:24.751735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:25.052023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2485): Launched 11:32:25.313100 run iperf3-srv_10.42.42.10(pid=2486): Launched 11:32:25.426189 tst iperf3m4.py:8: start network... 11:32:25.626563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:26.089539 run create_hlr_db(pid=2487): Launched 11:32:26.204531 bus /gobi_6: Setting Powered False 11:32:27.265364 run create_hlr_db(pid=2487): Terminated: ok {rc=0} 11:32:27.682092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Launched 11:32:27.981206 run osmo-hlr_10.42.42.2(pid=2490): Launched 11:32:28.096151 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:28.615577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Launched 11:32:28.915199 run osmo-stp_10.42.42.5(pid=2493): Launched 11:32:29.030631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:29.558408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2495): Launched 11:32:29.673182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:29.926301 run patchelf(pid=2496): Launched 11:32:30.093816 run osmo-stp_10.42.42.5(pid=2493): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] 11:32:30.221239 run osmo-stp_10.42.42.5(pid=2493): stdout: | (launched: 2022-12-10_11:32:28.860468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:30.350119 run osmo-stp_10.42.42.5(pid=2493): stderr: | 20221210113229031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113229032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113229032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113229032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113229033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113229033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113229033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:30.479148 run osmo-stp_10.42.42.5(pid=2493): stdout: | (launched: 2022-12-10_11:32:28.860468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:30.602679 run osmo-stp_10.42.42.5(pid=2493): stderr: | 20221210113229031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113229032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113229032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113229032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113229033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113229033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113229033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:30.748279 run patchelf(pid=2496): Terminating (SIGINT) 11:32:30.925119 run patchelf(pid=2496): Terminated: ok {rc=0} 11:32:31.049091 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2493): Process ended prematurely: osmo-stp_10.42.42.5(pid=2493) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:32:31.059621 tst iperf3m4.py:8: Test FAILED (10.3 sec) 11:32:31.090325 run osmo-hlr_10.42.42.2(pid=2490): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2490)] 11:32:31.141306 run osmo-hlr_10.42.42.2(pid=2490): stdout: | (launched: 2022-12-10_11:32:27.926393) 11:32:31.193518 run osmo-hlr_10.42.42.2(pid=2490): stderr: | 20221210113228102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113228102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113228102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113228102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113228102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113228102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113228114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113228122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113228123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113228123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:31.246076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2479): Terminating (SIGTERM) 11:32:31.288626 run iperf3-srv_10.42.42.10(pid=2480): Terminating (SIGTERM) 11:32:31.330711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2481): Terminating (SIGTERM) 11:32:31.373559 run iperf3-srv_10.42.42.10(pid=2482): Terminating (SIGTERM) 11:32:31.417328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2483): Terminating (SIGTERM) 11:32:31.459777 run iperf3-srv_10.42.42.10(pid=2484): Terminating (SIGTERM) 11:32:31.501775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2485): Terminating (SIGTERM) 11:32:31.543818 run iperf3-srv_10.42.42.10(pid=2486): Terminating (SIGTERM) 11:32:31.587473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Terminating (SIGTERM) 11:32:31.630121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Terminating (SIGTERM) 11:32:31.672038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2495): Terminating (SIGTERM) 11:32:31.714544 --- ParallelTerminationStrategy: PID 2479 died... 11:32:31.734263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2479): Terminated: ok {rc=0} 11:32:31.781971 --- ParallelTerminationStrategy: PID 2480 died... 11:32:31.801354 run iperf3-srv_10.42.42.10(pid=2480): Terminated {rc=256} 11:32:31.848606 --- ParallelTerminationStrategy: PID 2481 died... 11:32:31.868291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2481): Terminated: ok {rc=0} 11:32:31.915522 --- ParallelTerminationStrategy: PID 2482 died... 11:32:31.934957 run iperf3-srv_10.42.42.10(pid=2482): Terminated {rc=256} 11:32:31.981962 --- ParallelTerminationStrategy: PID 2483 died... 11:32:32.001485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2483): Terminated: ok {rc=0} 11:32:32.048807 --- ParallelTerminationStrategy: PID 2484 died... 11:32:32.068284 run iperf3-srv_10.42.42.10(pid=2484): Terminated {rc=256} 11:32:32.115616 --- ParallelTerminationStrategy: PID 2485 died... 11:32:32.135006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2485): Terminated: ok {rc=0} 11:32:32.182047 --- ParallelTerminationStrategy: PID 2486 died... 11:32:32.201526 run iperf3-srv_10.42.42.10(pid=2486): Terminated {rc=256} 11:32:32.245982 --- ParallelTerminationStrategy: PID 2489 died... 11:32:32.264494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Terminated: ok {rc=0} 11:32:32.309027 --- ParallelTerminationStrategy: PID 2492 died... 11:32:32.327449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Terminated: ok {rc=0} 11:32:32.371554 --- ParallelTerminationStrategy: PID 2495 died... 11:32:32.390064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2495): Terminated: ok {rc=0} 11:32:32.475650 bus /gobi_4: Setting Powered False 11:32:33.575371 bus /gobi_4: Setting Powered False 11:32:34.691749 bus /gobi_1: Setting Powered False 11:32:35.789752 bus /gobi_1: Setting Powered False 11:32:36.903537 bus /gobi_0: Setting Powered False 11:32:38.001812 bus /gobi_0: Setting Powered False 11:32:39.120366 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:32:40.223780 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.235171 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:32:40.292123 tst ping.py: using LAC 28098 11:32:40.407450 tst ping.py: using RAC 48 11:32:40.525755 tst ping.py: using CellId 28098 11:32:40.638773 tst ping.py: using BVCI 28099 11:32:40.745665 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.756432 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.767075 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.777867 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.788541 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.799229 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.810207 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:40.820937 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:32:40.935536 tst ping.py:19: start network... 11:32:41.132467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:41.586567 run create_hlr_db(pid=2497): Launched 11:32:41.698592 bus /gobi_6: Setting Powered False 11:32:42.757670 run create_hlr_db(pid=2497): Terminated: ok {rc=0} 11:32:43.189277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2499): Launched 11:32:43.503952 run osmo-hlr_10.42.42.2(pid=2500): Launched 11:32:43.625339 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:44.170005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2502): Launched 11:32:44.483076 run osmo-stp_10.42.42.5(pid=2503): Launched 11:32:44.604135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:45.146514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2505): Launched 11:32:45.266773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:45.531999 run patchelf(pid=2506): Launched 11:32:45.706830 run osmo-stp_10.42.42.5(pid=2503): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2503)] 11:32:45.848861 run osmo-stp_10.42.42.5(pid=2503): stdout: | (launched: 2022-12-10_11:32:44.426226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:45.985650 run osmo-stp_10.42.42.5(pid=2503): stderr: | 20221210113244618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113244618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113244618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113244619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113244619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113244619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113244619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:46.116780 run osmo-stp_10.42.42.5(pid=2503): stdout: | (launched: 2022-12-10_11:32:44.426226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:46.241672 run osmo-stp_10.42.42.5(pid=2503): stderr: | 20221210113244618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113244618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113244618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113244619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113244619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113244619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113244619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:46.390577 run patchelf(pid=2506): Terminating (SIGINT) 11:32:46.561070 run patchelf(pid=2506): Terminated: ok {rc=0} 11:32:46.685838 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2503): Process ended prematurely: osmo-stp_10.42.42.5(pid=2503) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2503)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 11:32:46.696053 tst ping.py:22: Test FAILED (6.5 sec) 11:32:46.727325 run osmo-hlr_10.42.42.2(pid=2500): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2500)] 11:32:46.779752 run osmo-hlr_10.42.42.2(pid=2500): stdout: | (launched: 2022-12-10_11:32:43.447098) 11:32:46.832177 run osmo-hlr_10.42.42.2(pid=2500): stderr: | 20221210113243645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113243645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113243645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113243645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113243645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113243645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113243658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113243668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113243668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113243668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:46.885207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2499): Terminating (SIGTERM) 11:32:46.928335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2502): Terminating (SIGTERM) 11:32:46.973227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2505): Terminating (SIGTERM) 11:32:47.019304 --- ParallelTerminationStrategy: PID 2499 died... 11:32:47.039803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2499): Terminated: ok {rc=0} 11:32:47.088715 --- ParallelTerminationStrategy: PID 2502 died... 11:32:47.108291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2502): Terminated: ok {rc=0} 11:32:47.155833 --- ParallelTerminationStrategy: PID 2505 died... 11:32:47.176934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2505): Terminated: ok {rc=0} 11:32:47.264509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:32:48.353399 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.365367 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:32:48.423940 tst ping_idle_ping.py: using LAC 28099 11:32:48.541369 tst ping_idle_ping.py: using RAC 49 11:32:48.658492 tst ping_idle_ping.py: using CellId 28099 11:32:48.776267 tst ping_idle_ping.py: using BVCI 28100 11:32:48.891949 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.903435 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.914710 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.926023 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.937197 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.948098 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.959283 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:32:48.970285 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:32:49.086971 tst ping_idle_ping.py:24: start network... 11:32:49.300076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:49.795586 run create_hlr_db(pid=2507): Launched 11:32:49.922996 bus /gobi_6: Setting Powered False 11:32:50.984872 run create_hlr_db(pid=2507): Terminated: ok {rc=0} 11:32:51.404253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Launched 11:32:51.698322 run osmo-hlr_10.42.42.2(pid=2510): Launched 11:32:51.810820 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:52.324852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Launched 11:32:52.617740 run osmo-stp_10.42.42.5(pid=2513): Launched 11:32:52.731493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:53.237998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2515): Launched 11:32:53.350296 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:53.597921 run patchelf(pid=2516): Launched 11:32:53.761115 run osmo-stp_10.42.42.5(pid=2513): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] 11:32:53.885332 run osmo-stp_10.42.42.5(pid=2513): stdout: | (launched: 2022-12-10_11:32:52.564477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:54.010927 run osmo-stp_10.42.42.5(pid=2513): stderr: | 20221210113252734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113252734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113252734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113252735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113252735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113252735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113252735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:54.136644 run osmo-stp_10.42.42.5(pid=2513): stdout: | (launched: 2022-12-10_11:32:52.564477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:54.257403 run osmo-stp_10.42.42.5(pid=2513): stderr: | 20221210113252734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113252734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113252734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113252735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113252735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113252735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113252735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:54.399928 run patchelf(pid=2516): Terminating (SIGINT) 11:32:54.564384 run patchelf(pid=2516): Terminated: ok {rc=0} 11:32:54.683353 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2513): Process ended prematurely: osmo-stp_10.42.42.5(pid=2513) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:32:54.692050 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 11:32:54.718590 run osmo-hlr_10.42.42.2(pid=2510): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2510)] 11:32:54.766090 run osmo-hlr_10.42.42.2(pid=2510): stdout: | (launched: 2022-12-10_11:32:51.645063) 11:32:54.815136 run osmo-hlr_10.42.42.2(pid=2510): stderr: | 20221210113251821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113251821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113251821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113251821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113251821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113251821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113251833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113251841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113251842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113251842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:54.864414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Terminating (SIGTERM) 11:32:54.903818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Terminating (SIGTERM) 11:32:54.943087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2515): Terminating (SIGTERM) 11:32:54.982943 --- ParallelTerminationStrategy: PID 2509 died... 11:32:55.001745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Terminated: ok {rc=0} 11:32:55.045688 --- ParallelTerminationStrategy: PID 2512 died... 11:32:55.063995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Terminated: ok {rc=0} 11:32:55.107888 --- ParallelTerminationStrategy: PID 2515 died... 11:32:55.126373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2515): Terminated: ok {rc=0} 11:32:55.209406 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:32:56.490889 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:32:56.497268 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:32:56.517867 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:32:56.552131 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:32:56.605996 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:32:56.626694 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:32:56.660724 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:32:57.215059 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:32:57.219923 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.230874 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:32:57.286009 tst switch_tch_pdch.py: using LAC 28100 11:32:57.402770 tst switch_tch_pdch.py: using RAC 50 11:32:57.518565 tst switch_tch_pdch.py: using CellId 28100 11:32:57.632937 tst switch_tch_pdch.py: using BVCI 28101 11:32:57.740043 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.751057 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.761862 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.772854 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.783861 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.794918 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.806130 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:32:57.817075 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:32:57.932864 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:32:58.048449 tst switch_tch_pdch.py:51: start network... 11:32:58.245270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:58.698640 run create_hlr_db(pid=2520): Launched 11:32:58.810946 bus /gobi_6: Setting Powered False 11:32:59.870246 run create_hlr_db(pid=2520): Terminated: ok {rc=0} 11:33:00.279885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2522): Launched 11:33:00.573334 run osmo-hlr_10.42.42.2(pid=2523): Launched 11:33:00.686532 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:01.207274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2526): Launched 11:33:01.531139 run osmo-stp_10.42.42.5(pid=2527): Launched 11:33:01.811142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:02.400127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2529): Launched 11:33:02.513313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:02.759453 run patchelf(pid=2530): Launched 11:33:02.923525 run osmo-stp_10.42.42.5(pid=2527): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2527)] 11:33:03.047478 run osmo-stp_10.42.42.5(pid=2527): stdout: | (launched: 2022-12-10_11:33:01.463283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:03.173670 run osmo-stp_10.42.42.5(pid=2527): stderr: | 20221210113301739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113301739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113301739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113301740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113301740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113301740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113301740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:03.299072 run osmo-stp_10.42.42.5(pid=2527): stdout: | (launched: 2022-12-10_11:33:01.463283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:03.419041 run osmo-stp_10.42.42.5(pid=2527): stderr: | 20221210113301739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113301739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113301739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113301740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113301740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113301740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113301740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:03.561654 run patchelf(pid=2530): Terminating (SIGINT) 11:33:03.725582 run patchelf(pid=2530): Terminated: ok {rc=0} 11:33:03.843804 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2527): Process ended prematurely: osmo-stp_10.42.42.5(pid=2527) [trial-2374↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2527)] [trial-2374↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:33:03.852623 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:33:03.879438 run osmo-hlr_10.42.42.2(pid=2523): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2523)] 11:33:03.926647 run osmo-hlr_10.42.42.2(pid=2523): stdout: | (launched: 2022-12-10_11:33:00.519682) 11:33:03.975720 run osmo-hlr_10.42.42.2(pid=2523): stderr: | 20221210113300694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113300694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113300694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113300694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113300694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113300694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113300706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113300717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113300717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113300717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:04.025044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2522): Terminating (SIGTERM) 11:33:04.064325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2526): Terminating (SIGTERM) 11:33:04.103881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2529): Terminating (SIGTERM) 11:33:04.143381 --- ParallelTerminationStrategy: PID 2522 died... 11:33:04.162163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2522): Terminated: ok {rc=0} 11:33:04.206029 --- ParallelTerminationStrategy: PID 2526 died... 11:33:04.224133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2526): Terminated: ok {rc=0} 11:33:04.267766 --- ParallelTerminationStrategy: PID 2529 died... 11:33:04.285919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2529): Terminated: ok {rc=0} 11:33:04.368716 bus /gobi_0: Setting Powered False 11:33:05.466125 bus /gobi_0: Setting Powered False 11:33:06.581343 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:33:07.818632 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:07.824537 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:33:07.845610 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:33:07.880628 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:33:07.934878 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:33:07.956081 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:33:07.990981 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:33:08.544828 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:33:08.549923 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:08.561388 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:33:08.618404 tst switch_tch_pdch.py: using LAC 28101 11:33:08.743180 tst switch_tch_pdch.py: using RAC 51 11:33:08.865719 tst switch_tch_pdch.py: using CellId 28101 11:33:08.981364 tst switch_tch_pdch.py: using BVCI 28102 11:33:09.087717 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:09.098682 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:09.109361 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:09.120233 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:09.131073 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:09.141857 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:09.152692 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:33:09.163404 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:33:09.280440 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:33:09.398270 tst switch_tch_pdch.py:51: start network... 11:33:09.610454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:10.069308 run create_hlr_db(pid=2534): Launched 11:33:10.198929 bus /gobi_6: Setting Powered False 11:33:11.261419 run create_hlr_db(pid=2534): Terminated: ok {rc=0} 11:33:11.671588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2536): Launched 11:33:11.984244 run osmo-hlr_10.42.42.2(pid=2537): Launched 11:33:12.105093 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:12.615901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2539): Launched 11:33:12.929239 run osmo-stp_10.42.42.5(pid=2540): Launched 11:33:13.049832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:13.564633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2542): Launched 11:33:13.684468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:13.948037 run patchelf(pid=2543): Launched 11:33:14.122557 run osmo-stp_10.42.42.5(pid=2540): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2540)] 11:33:14.255353 run osmo-stp_10.42.42.5(pid=2540): stdout: | (launched: 2022-12-10_11:33:12.872083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:14.389349 run osmo-stp_10.42.42.5(pid=2540): stderr: | 20221210113313066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113313066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113313067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113313067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113313067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113313067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113313067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:14.523362 run osmo-stp_10.42.42.5(pid=2540): stdout: | (launched: 2022-12-10_11:33:12.872083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:14.651366 run osmo-stp_10.42.42.5(pid=2540): stderr: | 20221210113313066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113313066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113313067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113313067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113313067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113313067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113313067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:14.803618 run patchelf(pid=2543): Terminating (SIGINT) 11:33:14.978324 run patchelf(pid=2543): Terminated: ok {rc=0} 11:33:15.104258 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2540): Process ended prematurely: osmo-stp_10.42.42.5(pid=2540) [trial-2374↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2540)] [trial-2374↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:33:15.113656 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:33:15.141156 run osmo-hlr_10.42.42.2(pid=2537): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2537)] 11:33:15.191557 run osmo-hlr_10.42.42.2(pid=2537): stdout: | (launched: 2022-12-10_11:33:11.927708) 11:33:15.243353 run osmo-hlr_10.42.42.2(pid=2537): stderr: | 20221210113312123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113312123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113312123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113312123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113312123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113312123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113312135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113312143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113312143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113312144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:15.295458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2536): Terminating (SIGTERM) 11:33:15.337277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2539): Terminating (SIGTERM) 11:33:15.378882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2542): Terminating (SIGTERM) 11:33:15.420285 --- ParallelTerminationStrategy: PID 2536 died... 11:33:15.439537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2536): Terminated: ok {rc=0} 11:33:15.485230 --- ParallelTerminationStrategy: PID 2539 died... 11:33:15.504472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2539): Terminated: ok {rc=0} 11:33:15.550447 --- ParallelTerminationStrategy: PID 2542 died... 11:33:15.569877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2542): Terminated: ok {rc=0} 11:33:15.657834 bus /gobi_0: Setting Powered False 11:33:16.759291 bus /gobi_0: Setting Powered False 11:33:17.884821 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_sms:trx-b200 --------------------------------------------------------------------- 11:33:19.122685 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:19.127175 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:33:19.161275 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:33:19.168177 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:33:19.219043 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:33:19.252232 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:33:19.259119 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:33:19.802815 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:33:19.807837 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 11:33:19.818838 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 11:33:19.868141 tst mo_mt_sms.py: using LAC 28102 11:33:19.990475 tst mo_mt_sms.py: using RAC 52 11:33:20.111538 tst mo_mt_sms.py: using CellId 28102 11:33:20.233369 tst mo_mt_sms.py: using BVCI 28103 11:33:20.346800 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:33:20.460270 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:33:20.574573 tst mo_mt_sms.py:9: start nitb and bts... 11:33:20.788355 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:33:21.431506 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2547): Launched 11:33:21.745572 run osmo-nitb_10.42.42.2(pid=2548): Launched 11:33:21.919653 run osmo-nitb_10.42.42.2(pid=2548): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2548)] 11:33:22.060572 run osmo-nitb_10.42.42.2(pid=2548): stdout: | (launched: 2022-12-10_11:33:21.688700) 11:33:22.203760 run osmo-nitb_10.42.42.2(pid=2548): stderr: | (launched: 2022-12-10_11:33:21.735267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:33:22.346464 run osmo-nitb_10.42.42.2(pid=2548): stdout: | (launched: 2022-12-10_11:33:21.688700) 11:33:22.483118 run osmo-nitb_10.42.42.2(pid=2548): stderr: | (launched: 2022-12-10_11:33:21.735267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2548) [trial-2374↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2548)] 11:33:22.865068 tst osmo-nitb_10.42.42.2(pid=2548): stdout: | (launched: 2022-12-10_11:33:21.688700) 11:33:22.992544 tst osmo-nitb_10.42.42.2(pid=2548): stderr: | (launched: 2022-12-10_11:33:21.735267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:33:23.142998 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2548) [trial-2374↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2548)] [trial-2374↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 11:33:23.151761 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:33:23.159148 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2547): Terminating (SIGTERM) 11:33:23.371129 --- ParallelTerminationStrategy: PID 2547 died... 11:33:23.392435 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2547): Terminated: ok {rc=0} 11:33:23.480610 bus /sierra_3: Setting Powered False 11:33:24.580825 bus /sierra_3: Setting Powered False 11:33:25.697446 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:trx-b200 --------------------------------------------------------------------- 11:33:26.895152 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:26.899220 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:33:26.932336 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:33:26.958564 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:33:27.010737 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:33:27.043262 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:33:27.069229 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:33:27.616686 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:33:27.622960 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:27.634516 tst sms:trx-b200: Using 1 x bts (candidates: 1) 11:33:27.686318 tst mo_mt_sms.py: using LAC 28103 11:33:27.814100 tst mo_mt_sms.py: using RAC 53 11:33:27.937863 tst mo_mt_sms.py: using CellId 28103 11:33:28.062900 tst mo_mt_sms.py: using BVCI 28104 11:33:28.179162 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:28.190078 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:28.200730 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:28.212128 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:28.223297 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:28.234471 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:33:28.349292 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:33:28.460259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:28.919636 run create_hlr_db(pid=2552): Launched 11:33:29.034296 bus /sierra_2: Setting Powered False 11:33:30.093513 run create_hlr_db(pid=2552): Terminated: ok {rc=0} 11:33:30.505515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2554): Launched 11:33:30.799577 run osmo-hlr_10.42.42.2(pid=2555): Launched 11:33:30.992643 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:31.636468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2557): Launched 11:33:31.963408 run osmo-stp_10.42.42.5(pid=2558): Launched 11:33:32.215479 run osmo-msc_10.42.42.6: Starting osmo-msc 11:33:32.819583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2560): Launched 11:33:33.134112 run osmo-msc_10.42.42.6(pid=2561): Launched 11:33:33.309528 run osmo-stp_10.42.42.5(pid=2558): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2558)] 11:33:33.441676 run osmo-stp_10.42.42.5(pid=2558): stdout: | (launched: 2022-12-10_11:33:31.901852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:33.574069 run osmo-stp_10.42.42.5(pid=2558): stderr: | 20221210113332135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113332135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113332135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113332135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113332136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113332136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113332136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:33.706226 run osmo-stp_10.42.42.5(pid=2558): stdout: | (launched: 2022-12-10_11:33:31.901852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:33.831685 run osmo-stp_10.42.42.5(pid=2558): stderr: | 20221210113332135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113332135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113332135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113332135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113332136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113332136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113332136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:33.982016 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2558): Process ended prematurely: osmo-stp_10.42.42.5(pid=2558) [trial-2374↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2558)] [trial-2374↪sms:trx-b200↪mo_mt_sms.py:16] 11:33:33.990955 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 11:33:34.018332 run osmo-hlr_10.42.42.2(pid=2555): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2555)] 11:33:34.068463 run osmo-hlr_10.42.42.2(pid=2555): stdout: | (launched: 2022-12-10_11:33:30.746117) 11:33:34.120059 run osmo-hlr_10.42.42.2(pid=2555): stderr: | 20221210113331013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113331013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113331013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113331013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113331013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113331013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113331033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113331051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113331051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113331051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:34.192032 run osmo-msc_10.42.42.6(pid=2561): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2561)] 11:33:34.241796 run osmo-msc_10.42.42.6(pid=2561): stdout: | (launched: 2022-12-10_11:33:33.076768) 11:33:34.293127 run osmo-msc_10.42.42.6(pid=2561): stderr: | 20221210113333399 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113333400 DLGLOBAL DEBUG validating counter group 0x7f443669bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113333400 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113333400 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113333400 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113333400 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113333403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113333404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113333404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113333404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:33:34.344900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2554): Terminating (SIGTERM) 11:33:34.386283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2557): Terminating (SIGTERM) 11:33:34.427783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2560): Terminating (SIGTERM) 11:33:34.469534 --- ParallelTerminationStrategy: PID 2554 died... 11:33:34.489462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2554): Terminated: ok {rc=0} 11:33:34.535388 --- ParallelTerminationStrategy: PID 2557 died... 11:33:34.554807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2557): Terminated: ok {rc=0} 11:33:34.600457 --- ParallelTerminationStrategy: PID 2560 died... 11:33:34.619688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2560): Terminated: ok {rc=0} 11:33:34.706165 bus /sierra_3: Setting Powered False 11:33:35.805376 bus /sierra_3: Setting Powered False 11:33:36.920602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-b200 --------------------------------------------------------------------- 11:33:38.150606 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:38.154605 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:33:38.188537 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:33:38.195429 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:33:38.230664 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:33:38.263808 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:33:38.270586 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:33:38.791160 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:33:38.796442 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 11:33:38.807562 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 11:33:38.855626 tst assert_extension.py: using LAC 28104 11:33:38.981804 tst assert_extension.py: using RAC 54 11:33:39.098242 tst assert_extension.py: using CellId 28104 11:33:39.212035 tst assert_extension.py: using BVCI 28105 11:33:39.318245 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 11:33:39.429512 tst assert_extension.py:10: start nitb and bts... 11:33:39.626774 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:33:40.251482 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2566): Launched 11:33:40.566259 run osmo-nitb_10.42.42.2(pid=2567): Launched 11:33:40.740486 run osmo-nitb_10.42.42.2(pid=2567): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2567)] 11:33:40.880939 run osmo-nitb_10.42.42.2(pid=2567): stdout: | (launched: 2022-12-10_11:33:40.508900) 11:33:41.022936 run osmo-nitb_10.42.42.2(pid=2567): stderr: | (launched: 2022-12-10_11:33:40.556131) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:33:41.165194 run osmo-nitb_10.42.42.2(pid=2567): stdout: | (launched: 2022-12-10_11:33:40.508900) 11:33:41.301656 run osmo-nitb_10.42.42.2(pid=2567): stderr: | (launched: 2022-12-10_11:33:40.556131) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2567): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2567) [trial-2374↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2567)] 11:33:41.685345 tst osmo-nitb_10.42.42.2(pid=2567): stdout: | (launched: 2022-12-10_11:33:40.508900) 11:33:41.812828 tst osmo-nitb_10.42.42.2(pid=2567): stderr: | (launched: 2022-12-10_11:33:40.556131) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:33:41.962538 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2567): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2567) [trial-2374↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2567)] [trial-2374↪nitb_ussd:trx-b200↪assert_extension.py:12] 11:33:41.971239 tst assert_extension.py:12: Test FAILED (3.2 sec) 11:33:41.978154 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2566): Terminating (SIGTERM) 11:33:42.188388 --- ParallelTerminationStrategy: PID 2566 died... 11:33:42.209623 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2566): Terminated: ok {rc=0} 11:33:42.296227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:trx-b200 --------------------------------------------------------------------- 11:33:43.476093 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:43.480109 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:33:43.513480 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:33:43.540483 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:33:43.576145 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:33:43.609877 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:33:43.636034 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:33:44.166693 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:33:44.171981 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:44.182842 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 11:33:44.230726 tst assert_extension.py: using LAC 28105 11:33:44.353195 tst assert_extension.py: using RAC 55 11:33:44.475801 tst assert_extension.py: using CellId 28105 11:33:44.600359 tst assert_extension.py: using BVCI 28106 11:33:44.707117 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:44.717529 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:44.727742 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:44.738362 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:44.749096 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:33:44.760013 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 11:33:44.879901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:45.367657 run create_hlr_db(pid=2571): Launched 11:33:45.495815 bus /sierra_2: Setting Powered False 11:33:46.569747 run create_hlr_db(pid=2571): Terminated: ok {rc=0} 11:33:47.077324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2573): Launched 11:33:47.404759 run osmo-hlr_10.42.42.2(pid=2574): Launched 11:33:47.524422 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:48.065225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2576): Launched 11:33:48.379549 run osmo-stp_10.42.42.5(pid=2577): Launched 11:33:48.499486 run osmo-msc_10.42.42.6: Starting osmo-msc 11:33:49.065174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2579): Launched 11:33:49.378913 run osmo-msc_10.42.42.6(pid=2580): Launched 11:33:49.553524 run osmo-stp_10.42.42.5(pid=2577): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2577)] 11:33:49.686582 run osmo-stp_10.42.42.5(pid=2577): stdout: | (launched: 2022-12-10_11:33:48.322306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:49.820283 run osmo-stp_10.42.42.5(pid=2577): stderr: | 20221210113348512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113348512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113348512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113348513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113348513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113348513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113348513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:49.952091 run osmo-stp_10.42.42.5(pid=2577): stdout: | (launched: 2022-12-10_11:33:48.322306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:50.077457 run osmo-stp_10.42.42.5(pid=2577): stderr: | 20221210113348512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113348512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113348512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113348513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113348513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113348513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113348513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:50.227197 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2577): Process ended prematurely: osmo-stp_10.42.42.5(pid=2577) [trial-2374↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2577)] [trial-2374↪ussd:trx-b200↪assert_extension.py:17] 11:33:50.235893 tst assert_extension.py:17: Test FAILED (6.1 sec) 11:33:50.262800 run osmo-hlr_10.42.42.2(pid=2574): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2574)] 11:33:50.312057 run osmo-hlr_10.42.42.2(pid=2574): stdout: | (launched: 2022-12-10_11:33:47.347650) 11:33:50.362987 run osmo-hlr_10.42.42.2(pid=2574): stderr: | 20221210113347545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113347546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113347546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113347546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113347546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113347546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113347559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113347567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113347567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113347567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:50.434666 run osmo-msc_10.42.42.6(pid=2580): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2580)] 11:33:50.484017 run osmo-msc_10.42.42.6(pid=2580): stdout: | (launched: 2022-12-10_11:33:49.322086) 11:33:50.535273 run osmo-msc_10.42.42.6(pid=2580): stderr: | 20221210113349641 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113349641 DLGLOBAL DEBUG validating counter group 0x7f47b7510c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113349641 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113349641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113349641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113349641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113349643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113349643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113349643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113349644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:33:50.586752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2573): Terminating (SIGTERM) 11:33:50.627877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2576): Terminating (SIGTERM) 11:33:50.669433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2579): Terminating (SIGTERM) 11:33:50.711242 --- ParallelTerminationStrategy: PID 2573 died... 11:33:50.731190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2573): Terminated: ok {rc=0} 11:33:50.777150 --- ParallelTerminationStrategy: PID 2576 died... 11:33:50.796320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2576): Terminated: ok {rc=0} 11:33:50.841955 --- ParallelTerminationStrategy: PID 2579 died... 11:33:50.861310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2579): Terminated: ok {rc=0} 11:33:50.948732 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:33:52.163518 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:52.170874 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:33:52.205104 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:33:52.232228 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:33:52.286764 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:33:52.321095 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:33:52.347155 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:33:52.896835 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:33:52.949906 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:33:52.961309 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:33:53.034338 tst mo_mt_call.py: using LAC 28106 11:33:53.159124 tst mo_mt_call.py: using RAC 56 11:33:53.283881 tst mo_mt_call.py: using CellId 28106 11:33:53.407189 tst mo_mt_call.py: using BVCI 28107 11:33:53.522621 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:33:53.534058 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:33:53.545246 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:33:53.556412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:33:53.567653 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:33:53.578779 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:33:53.694256 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:33:53.813439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:54.307416 run create_hlr_db(pid=2585): Launched 11:33:54.437003 bus /sierra_2: Setting Powered False 11:33:55.500592 run create_hlr_db(pid=2585): Terminated: ok {rc=0} 11:33:55.945432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Launched 11:33:56.264559 run osmo-hlr_10.42.42.2(pid=2588): Launched 11:33:56.386506 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:56.938017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Launched 11:33:57.259337 run osmo-stp_10.42.42.5(pid=2591): Launched 11:33:57.382087 run osmo-msc_10.42.42.6: Starting osmo-msc 11:33:57.961064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2593): Launched 11:33:58.281997 run osmo-msc_10.42.42.6(pid=2594): Launched 11:33:58.460398 run osmo-stp_10.42.42.5(pid=2591): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] 11:33:58.595596 run osmo-stp_10.42.42.5(pid=2591): stdout: | (launched: 2022-12-10_11:33:57.200658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:58.730935 run osmo-stp_10.42.42.5(pid=2591): stderr: | 20221210113357391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113357391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113357391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113357392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113357394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113357394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113357394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:58.865312 run osmo-stp_10.42.42.5(pid=2591): stdout: | (launched: 2022-12-10_11:33:57.200658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:58.993171 run osmo-stp_10.42.42.5(pid=2591): stderr: | 20221210113357391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113357391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113357391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113357392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113357394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113357394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113357394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:59.146556 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2591): Process ended prematurely: osmo-stp_10.42.42.5(pid=2591) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:33:59.156153 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:33:59.184002 run osmo-hlr_10.42.42.2(pid=2588): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2588)] 11:33:59.233835 run osmo-hlr_10.42.42.2(pid=2588): stdout: | (launched: 2022-12-10_11:33:56.206719) 11:33:59.286062 run osmo-hlr_10.42.42.2(pid=2588): stderr: | 20221210113356406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113356407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113356407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113356407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113356407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113356407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113356419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113356427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113356428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113356428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:59.358050 run osmo-msc_10.42.42.6(pid=2594): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2594)] 11:33:59.408043 run osmo-msc_10.42.42.6(pid=2594): stdout: | (launched: 2022-12-10_11:33:58.224036) 11:33:59.459615 run osmo-msc_10.42.42.6(pid=2594): stderr: | 20221210113358545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113358545 DLGLOBAL DEBUG validating counter group 0x7eff357f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113358546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113358546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113358546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113358546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113358548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113358548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113358548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113358548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:33:59.511487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Terminating (SIGTERM) 11:33:59.552785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Terminating (SIGTERM) 11:33:59.594319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2593): Terminating (SIGTERM) 11:33:59.636263 --- ParallelTerminationStrategy: PID 2587 died... 11:33:59.655584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Terminated: ok {rc=0} 11:33:59.701148 --- ParallelTerminationStrategy: PID 2590 died... 11:33:59.720322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Terminated: ok {rc=0} 11:33:59.766600 --- ParallelTerminationStrategy: PID 2593 died... 11:33:59.786135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2593): Terminated: ok {rc=0} 11:33:59.874032 bus /sierra_3: Setting Powered False 11:34:00.988319 bus /sierra_3: Setting Powered False 11:34:02.111148 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:34:03.265949 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:34:03.278135 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:34:03.348774 tst mo_mt_call_osmux.py: using LAC 28107 11:34:03.475682 tst mo_mt_call_osmux.py: using RAC 57 11:34:03.600792 tst mo_mt_call_osmux.py: using CellId 28107 11:34:03.725364 tst mo_mt_call_osmux.py: using BVCI 28108 11:34:03.841130 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:34:03.852524 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:34:03.863787 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:34:03.875080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:34:03.886376 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:34:03.897537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:34:04.010811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:34:04.124741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:04.586379 run create_hlr_db(pid=2596): Launched 11:34:04.701354 bus /sierra_2: Setting Powered False 11:34:05.760861 run create_hlr_db(pid=2596): Terminated: ok {rc=0} 11:34:06.198740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2598): Launched 11:34:06.517210 run osmo-hlr_10.42.42.2(pid=2599): Launched 11:34:06.640350 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:07.192445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2601): Launched 11:34:07.512707 run osmo-stp_10.42.42.5(pid=2602): Launched 11:34:07.634659 run osmo-msc_10.42.42.6: Starting osmo-msc 11:34:08.209857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2604): Launched 11:34:08.529006 run osmo-msc_10.42.42.6(pid=2605): Launched 11:34:08.707484 run osmo-stp_10.42.42.5(pid=2602): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2602)] 11:34:08.841998 run osmo-stp_10.42.42.5(pid=2602): stdout: | (launched: 2022-12-10_11:34:07.454733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:08.976608 run osmo-stp_10.42.42.5(pid=2602): stderr: | 20221210113407646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113407646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113407647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113407647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113407649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113407650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113407650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:09.110621 run osmo-stp_10.42.42.5(pid=2602): stdout: | (launched: 2022-12-10_11:34:07.454733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:09.238925 run osmo-stp_10.42.42.5(pid=2602): stderr: | 20221210113407646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113407646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113407647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113407647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113407649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113407650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113407650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:09.392044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2602): Process ended prematurely: osmo-stp_10.42.42.5(pid=2602) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2602)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:34:09.401706 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:34:09.429125 run osmo-hlr_10.42.42.2(pid=2599): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2599)] 11:34:09.478767 run osmo-hlr_10.42.42.2(pid=2599): stdout: | (launched: 2022-12-10_11:34:06.459782) 11:34:09.529776 run osmo-hlr_10.42.42.2(pid=2599): stderr: | 20221210113406658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113406658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113406658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113406658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113406658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113406658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113406670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113406679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113406679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113406679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:09.601346 run osmo-msc_10.42.42.6(pid=2605): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2605)] 11:34:09.650741 run osmo-msc_10.42.42.6(pid=2605): stdout: | (launched: 2022-12-10_11:34:08.471166) 11:34:09.701555 run osmo-msc_10.42.42.6(pid=2605): stderr: | 20221210113408793 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113408793 DLGLOBAL DEBUG validating counter group 0x7f08bf682c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113408794 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113408794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113408794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113408794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113408797 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113408798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113408798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113408798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:34:09.752727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2598): Terminating (SIGTERM) 11:34:09.793917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2601): Terminating (SIGTERM) 11:34:09.835167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2604): Terminating (SIGTERM) 11:34:09.876486 --- ParallelTerminationStrategy: PID 2598 died... 11:34:09.895990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2598): Terminated: ok {rc=0} 11:34:09.941723 --- ParallelTerminationStrategy: PID 2601 died... 11:34:09.960943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2601): Terminated: ok {rc=0} 11:34:10.006623 --- ParallelTerminationStrategy: PID 2604 died... 11:34:10.025993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2604): Terminated: ok {rc=0} 11:34:10.112205 bus /sierra_3: Setting Powered False 11:34:11.210838 bus /sierra_3: Setting Powered False 11:34:12.323029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:34:13.574171 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:34:13.581309 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:34:13.614577 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:34:13.641525 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:34:13.694811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:34:13.728667 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:34:13.755674 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:34:14.305805 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:34:14.356748 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:14.368209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:34:14.437864 tst mo_mt_call.py: using LAC 28108 11:34:14.564496 tst mo_mt_call.py: using RAC 58 11:34:14.695287 tst mo_mt_call.py: using CellId 28108 11:34:14.819551 tst mo_mt_call.py: using BVCI 28109 11:34:14.935331 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:14.946722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:14.957969 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:14.969169 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:14.980412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:14.991599 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:34:15.110154 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:34:15.225317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:15.690038 run create_hlr_db(pid=2610): Launched 11:34:15.804511 bus /sierra_2: Setting Powered False 11:34:16.870639 run create_hlr_db(pid=2610): Terminated: ok {rc=0} 11:34:17.329991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2612): Launched 11:34:17.636101 run osmo-hlr_10.42.42.2(pid=2613): Launched 11:34:17.752102 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:18.276346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2615): Launched 11:34:18.574349 run osmo-stp_10.42.42.5(pid=2616): Launched 11:34:18.688933 run osmo-msc_10.42.42.6: Starting osmo-msc 11:34:19.241141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2618): Launched 11:34:19.540418 run osmo-msc_10.42.42.6(pid=2619): Launched 11:34:19.708240 run osmo-stp_10.42.42.5(pid=2616): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2616)] 11:34:19.836110 run osmo-stp_10.42.42.5(pid=2616): stdout: | (launched: 2022-12-10_11:34:18.519945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:19.963085 run osmo-stp_10.42.42.5(pid=2616): stderr: | 20221210113418691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113418692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113418692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113418692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113418693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113418693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113418693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:20.087354 run osmo-stp_10.42.42.5(pid=2616): stdout: | (launched: 2022-12-10_11:34:18.519945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:20.206842 run osmo-stp_10.42.42.5(pid=2616): stderr: | 20221210113418691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113418692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113418692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113418692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113418693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113418693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113418693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:20.349560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2616): Process ended prematurely: osmo-stp_10.42.42.5(pid=2616) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2616)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:34:20.358611 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:34:20.385226 run osmo-hlr_10.42.42.2(pid=2613): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2613)] 11:34:20.432638 run osmo-hlr_10.42.42.2(pid=2613): stdout: | (launched: 2022-12-10_11:34:17.581806) 11:34:20.481555 run osmo-hlr_10.42.42.2(pid=2613): stderr: | 20221210113417757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113417757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113417757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113417757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113417757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113417757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113417768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113417778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113417778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113417778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:20.549392 run osmo-msc_10.42.42.6(pid=2619): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2619)] 11:34:20.596523 run osmo-msc_10.42.42.6(pid=2619): stdout: | (launched: 2022-12-10_11:34:19.486156) 11:34:20.645292 run osmo-msc_10.42.42.6(pid=2619): stderr: | 20221210113419758 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113419758 DLGLOBAL DEBUG validating counter group 0x7ff0cf55cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113419759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113419759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113419759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113419759 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113419761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113419762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113419762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113419762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:34:20.694419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2612): Terminating (SIGTERM) 11:34:20.733936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2615): Terminating (SIGTERM) 11:34:20.774056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2618): Terminating (SIGTERM) 11:34:20.813926 --- ParallelTerminationStrategy: PID 2612 died... 11:34:20.832746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2612): Terminated: ok {rc=0} 11:34:20.876811 --- ParallelTerminationStrategy: PID 2615 died... 11:34:20.895680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2615): Terminated: ok {rc=0} 11:34:20.940658 --- ParallelTerminationStrategy: PID 2618 died... 11:34:20.959348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2618): Terminated: ok {rc=0} 11:34:21.043483 bus /sierra_3: Setting Powered False 11:34:22.142088 bus /sierra_3: Setting Powered False 11:34:23.261417 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:34:24.407856 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:24.419546 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:34:24.488308 tst mo_mt_call_osmux.py: using LAC 28109 11:34:24.607325 tst mo_mt_call_osmux.py: using RAC 59 11:34:24.725747 tst mo_mt_call_osmux.py: using CellId 28109 11:34:24.842424 tst mo_mt_call_osmux.py: using BVCI 28110 11:34:24.950381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:24.961370 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:24.972203 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:24.983221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:24.994367 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:34:25.005242 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:34:25.119636 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:34:25.237667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:25.734367 run create_hlr_db(pid=2621): Launched 11:34:25.864134 bus /sierra_2: Setting Powered False 11:34:26.928503 run create_hlr_db(pid=2621): Terminated: ok {rc=0} 11:34:27.357457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2623): Launched 11:34:27.657689 run osmo-hlr_10.42.42.2(pid=2624): Launched 11:34:27.771995 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:28.297488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2626): Launched 11:34:28.595995 run osmo-stp_10.42.42.5(pid=2627): Launched 11:34:28.710101 run osmo-msc_10.42.42.6: Starting osmo-msc 11:34:29.255331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2629): Launched 11:34:29.555074 run osmo-msc_10.42.42.6(pid=2630): Launched 11:34:29.722445 run osmo-stp_10.42.42.5(pid=2627): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2627)] 11:34:29.848665 run osmo-stp_10.42.42.5(pid=2627): stdout: | (launched: 2022-12-10_11:34:28.541515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:29.975419 run osmo-stp_10.42.42.5(pid=2627): stderr: | 20221210113428711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113428711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113428711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113428712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113428712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113428712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113428712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:30.099771 run osmo-stp_10.42.42.5(pid=2627): stdout: | (launched: 2022-12-10_11:34:28.541515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:30.219178 run osmo-stp_10.42.42.5(pid=2627): stderr: | 20221210113428711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113428711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113428711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113428712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113428712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113428712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113428712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:30.362589 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2627): Process ended prematurely: osmo-stp_10.42.42.5(pid=2627) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2627)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:34:30.371423 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:34:30.398011 run osmo-hlr_10.42.42.2(pid=2624): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2624)] 11:34:30.445330 run osmo-hlr_10.42.42.2(pid=2624): stdout: | (launched: 2022-12-10_11:34:27.602866) 11:34:30.494452 run osmo-hlr_10.42.42.2(pid=2624): stderr: | 20221210113427781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113427781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113427781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113427781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113427781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113427781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113427793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113427803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113427804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113427804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:30.562404 run osmo-msc_10.42.42.6(pid=2630): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2630)] 11:34:30.609481 run osmo-msc_10.42.42.6(pid=2630): stdout: | (launched: 2022-12-10_11:34:29.500604) 11:34:30.658294 run osmo-msc_10.42.42.6(pid=2630): stderr: | 20221210113429770 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113429770 DLGLOBAL DEBUG validating counter group 0x7f591db7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113429770 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113429770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113429770 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113429770 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113429772 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113429772 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113429773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113429773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:34:30.707667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2623): Terminating (SIGTERM) 11:34:30.746703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2626): Terminating (SIGTERM) 11:34:30.786031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2629): Terminating (SIGTERM) 11:34:30.825758 --- ParallelTerminationStrategy: PID 2623 died... 11:34:30.845565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2623): Terminated: ok {rc=0} 11:34:30.894512 --- ParallelTerminationStrategy: PID 2626 died... 11:34:30.913594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2626): Terminated: ok {rc=0} 11:34:30.958373 --- ParallelTerminationStrategy: PID 2629 died... 11:34:30.977062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2629): Terminated: ok {rc=0} 11:34:31.061108 bus /sierra_3: Setting Powered False 11:34:32.163917 bus /sierra_3: Setting Powered False 11:34:33.286874 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:34:34.540651 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:34:34.548003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:34:34.583149 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:34:34.610744 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:34:34.665238 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:34:34.699721 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:34:34.727094 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:34:35.279887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:34:35.333259 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:35.344566 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:34:35.414725 tst mo_mt_call.py: using LAC 28110 11:34:35.537182 tst mo_mt_call.py: using RAC 60 11:34:35.660651 tst mo_mt_call.py: using CellId 28110 11:34:35.797361 tst mo_mt_call.py: using BVCI 28111 11:34:35.915179 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:35.926658 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:35.937856 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:35.949025 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:35.960160 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:35.971395 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:34:36.088562 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:34:36.203214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:36.698843 run create_hlr_db(pid=2635): Launched 11:34:36.827950 bus /sierra_2: Setting Powered False 11:34:37.890880 run create_hlr_db(pid=2635): Terminated: ok {rc=0} 11:34:38.334194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2637): Launched 11:34:38.652860 run osmo-hlr_10.42.42.2(pid=2638): Launched 11:34:38.774815 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:39.324340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2640): Launched 11:34:39.643732 run osmo-stp_10.42.42.5(pid=2641): Launched 11:34:39.765409 run osmo-msc_10.42.42.6: Starting osmo-msc 11:34:40.341473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2643): Launched 11:34:40.660721 run osmo-msc_10.42.42.6(pid=2644): Launched 11:34:40.838554 run osmo-stp_10.42.42.5(pid=2641): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2641)] 11:34:40.972755 run osmo-stp_10.42.42.5(pid=2641): stdout: | (launched: 2022-12-10_11:34:39.586052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:41.107524 run osmo-stp_10.42.42.5(pid=2641): stderr: | 20221210113439777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113439777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113439777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113439777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113439779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113439779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113439779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:41.242079 run osmo-stp_10.42.42.5(pid=2641): stdout: | (launched: 2022-12-10_11:34:39.586052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:41.369769 run osmo-stp_10.42.42.5(pid=2641): stderr: | 20221210113439777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113439777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113439777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113439777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113439779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113439779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113439779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:41.522055 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2641): Process ended prematurely: osmo-stp_10.42.42.5(pid=2641) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2641)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:34:41.531692 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:34:41.559498 run osmo-hlr_10.42.42.2(pid=2638): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2638)] 11:34:41.609721 run osmo-hlr_10.42.42.2(pid=2638): stdout: | (launched: 2022-12-10_11:34:38.595280) 11:34:41.661389 run osmo-hlr_10.42.42.2(pid=2638): stderr: | 20221210113438795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113438795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113438795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113438795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113438795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113438795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113438812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113438823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113438823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113438823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:41.733991 run osmo-msc_10.42.42.6(pid=2644): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2644)] 11:34:41.783547 run osmo-msc_10.42.42.6(pid=2644): stdout: | (launched: 2022-12-10_11:34:40.602757) 11:34:41.834540 run osmo-msc_10.42.42.6(pid=2644): stderr: | 20221210113440925 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113440926 DLGLOBAL DEBUG validating counter group 0x7f52cd514c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113440926 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113440926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113440926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113440926 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113440928 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113440928 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113440928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113440928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:34:41.885990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2637): Terminating (SIGTERM) 11:34:41.927113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2640): Terminating (SIGTERM) 11:34:41.968354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2643): Terminating (SIGTERM) 11:34:42.009950 --- ParallelTerminationStrategy: PID 2637 died... 11:34:42.029351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2637): Terminated: ok {rc=0} 11:34:42.075286 --- ParallelTerminationStrategy: PID 2640 died... 11:34:42.094690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2640): Terminated: ok {rc=0} 11:34:42.140908 --- ParallelTerminationStrategy: PID 2643 died... 11:34:42.160523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2643): Terminated: ok {rc=0} 11:34:42.249356 bus /sierra_3: Setting Powered False 11:34:43.349332 bus /sierra_3: Setting Powered False 11:34:44.463934 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:34:45.612256 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:45.624522 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:34:45.698525 tst mo_mt_call_osmux.py: using LAC 28111 11:34:45.816117 tst mo_mt_call_osmux.py: using RAC 61 11:34:45.959684 tst mo_mt_call_osmux.py: using CellId 28111 11:34:46.089654 tst mo_mt_call_osmux.py: using BVCI 28112 11:34:46.201924 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:46.213948 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:46.226985 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:46.238694 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:46.251598 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:34:46.265604 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:34:46.384150 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:34:46.504669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:47.049128 run create_hlr_db(pid=2646): Launched 11:34:47.212543 bus /sierra_2: Setting Powered False 11:34:48.275270 run create_hlr_db(pid=2646): Terminated: ok {rc=0} 11:34:48.721533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Launched 11:34:49.040140 run osmo-hlr_10.42.42.2(pid=2649): Launched 11:34:49.162287 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:49.715870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2652): Launched 11:34:50.035330 run osmo-stp_10.42.42.5(pid=2653): Launched 11:34:50.156770 run osmo-msc_10.42.42.6: Starting osmo-msc 11:34:50.734977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2655): Launched 11:34:51.054433 run osmo-msc_10.42.42.6(pid=2656): Launched 11:34:51.232354 run osmo-stp_10.42.42.5(pid=2653): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2653)] 11:34:51.366703 run osmo-stp_10.42.42.5(pid=2653): stdout: | (launched: 2022-12-10_11:34:49.977373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:51.501324 run osmo-stp_10.42.42.5(pid=2653): stderr: | 20221210113450170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113450170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113450171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113450171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113450171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113450172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113450172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:51.635813 run osmo-stp_10.42.42.5(pid=2653): stdout: | (launched: 2022-12-10_11:34:49.977373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:51.763824 run osmo-stp_10.42.42.5(pid=2653): stderr: | 20221210113450170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113450170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113450171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113450171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113450171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113450172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113450172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:51.916381 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2653): Process ended prematurely: osmo-stp_10.42.42.5(pid=2653) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2653)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:34:51.926030 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:34:51.953968 run osmo-hlr_10.42.42.2(pid=2649): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2649)] 11:34:52.003625 run osmo-hlr_10.42.42.2(pid=2649): stdout: | (launched: 2022-12-10_11:34:48.982306) 11:34:52.055122 run osmo-hlr_10.42.42.2(pid=2649): stderr: | 20221210113449180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113449180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113449180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113449180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113449180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113449181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113449193 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113449201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113449201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113449201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:52.126329 run osmo-msc_10.42.42.6(pid=2656): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2656)] 11:34:52.175903 run osmo-msc_10.42.42.6(pid=2656): stdout: | (launched: 2022-12-10_11:34:50.996418) 11:34:52.227486 run osmo-msc_10.42.42.6(pid=2656): stderr: | 20221210113451319 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113451319 DLGLOBAL DEBUG validating counter group 0x7faabaca2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113451319 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113451319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113451319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113451319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113451321 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113451322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113451322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113451322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:34:52.279061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Terminating (SIGTERM) 11:34:52.320445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2652): Terminating (SIGTERM) 11:34:52.361864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2655): Terminating (SIGTERM) 11:34:52.403034 --- ParallelTerminationStrategy: PID 2648 died... 11:34:52.422743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Terminated: ok {rc=0} 11:34:52.468360 --- ParallelTerminationStrategy: PID 2652 died... 11:34:52.487837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2652): Terminated: ok {rc=0} 11:34:52.533112 --- ParallelTerminationStrategy: PID 2655 died... 11:34:52.552424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2655): Terminated: ok {rc=0} 11:34:52.639369 bus /sierra_3: Setting Powered False 11:34:53.737534 bus /sierra_3: Setting Powered False 11:34:54.852633 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:34:56.101427 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:34:56.107791 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:34:56.141042 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:34:56.167094 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:34:56.219282 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:34:56.255055 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:34:56.282318 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:34:56.831163 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:34:56.882769 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:34:56.894338 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:34:56.965623 tst mo_mt_call.py: using LAC 28112 11:34:57.089674 tst mo_mt_call.py: using RAC 62 11:34:57.214945 tst mo_mt_call.py: using CellId 28112 11:34:57.342888 tst mo_mt_call.py: using BVCI 28113 11:34:57.452555 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:34:57.463626 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:34:57.474481 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:34:57.485661 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:34:57.496898 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:34:57.508246 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:34:57.626626 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:34:57.745603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:58.243915 run create_hlr_db(pid=2661): Launched 11:34:58.375054 bus /sierra_2: Setting Powered False 11:34:59.439487 run create_hlr_db(pid=2661): Terminated: ok {rc=0} 11:34:59.868816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2663): Launched 11:35:00.168451 run osmo-hlr_10.42.42.2(pid=2664): Launched 11:35:00.282499 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:00.800883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2666): Launched 11:35:01.131947 run osmo-stp_10.42.42.5(pid=2667): Launched 11:35:01.386877 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:02.033519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2672): Launched 11:35:02.348535 run osmo-msc_10.42.42.6(pid=2673): Launched 11:35:02.530394 run osmo-stp_10.42.42.5(pid=2667): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2667)] 11:35:02.667726 run osmo-stp_10.42.42.5(pid=2667): stdout: | (launched: 2022-12-10_11:35:01.070057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:02.804901 run osmo-stp_10.42.42.5(pid=2667): stderr: | 20221210113501335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113501335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113501336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113501336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113501336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113501343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113501343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:02.939298 run osmo-stp_10.42.42.5(pid=2667): stdout: | (launched: 2022-12-10_11:35:01.070057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:03.067739 run osmo-stp_10.42.42.5(pid=2667): stderr: | 20221210113501335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113501335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113501336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113501336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113501336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113501343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113501343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:03.220831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2667): Process ended prematurely: osmo-stp_10.42.42.5(pid=2667) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2667)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:35:03.230530 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:35:03.258025 run osmo-hlr_10.42.42.2(pid=2664): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2664)] 11:35:03.307946 run osmo-hlr_10.42.42.2(pid=2664): stdout: | (launched: 2022-12-10_11:35:00.113771) 11:35:03.359314 run osmo-hlr_10.42.42.2(pid=2664): stderr: | 20221210113500290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113500290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113500290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113500290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113500290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113500290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113500303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113500311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113500311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113500311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:03.430696 run osmo-msc_10.42.42.6(pid=2673): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2673)] 11:35:03.480164 run osmo-msc_10.42.42.6(pid=2673): stdout: | (launched: 2022-12-10_11:35:02.289724) 11:35:03.531384 run osmo-msc_10.42.42.6(pid=2673): stderr: | 20221210113502608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113502608 DLGLOBAL DEBUG validating counter group 0x7f00c5a8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113502608 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113502608 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113502608 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113502609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113502612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113502612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113502613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113502613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:03.583095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2663): Terminating (SIGTERM) 11:35:03.624250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2666): Terminating (SIGTERM) 11:35:03.665722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2672): Terminating (SIGTERM) 11:35:03.707491 --- ParallelTerminationStrategy: PID 2663 died... 11:35:03.727297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2663): Terminated: ok {rc=0} 11:35:03.773353 --- ParallelTerminationStrategy: PID 2666 died... 11:35:03.792927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2666): Terminated: ok {rc=0} 11:35:03.838888 --- ParallelTerminationStrategy: PID 2672 died... 11:35:03.858383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2672): Terminated: ok {rc=0} 11:35:03.946199 bus /sierra_3: Setting Powered False 11:35:05.045577 bus /sierra_3: Setting Powered False 11:35:06.161126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:35:07.309353 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:35:07.321502 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:35:07.393972 tst mo_mt_call_osmux.py: using LAC 28113 11:35:07.511748 tst mo_mt_call_osmux.py: using RAC 63 11:35:07.631871 tst mo_mt_call_osmux.py: using CellId 28113 11:35:07.747835 tst mo_mt_call_osmux.py: using BVCI 28114 11:35:07.856308 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:35:07.867273 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:35:07.878053 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:35:07.889007 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:35:07.900084 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:35:07.911037 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:35:08.031639 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:35:08.150826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:08.646522 run create_hlr_db(pid=2675): Launched 11:35:08.776208 bus /sierra_2: Setting Powered False 11:35:09.840753 run create_hlr_db(pid=2675): Terminated: ok {rc=0} 11:35:10.267622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2677): Launched 11:35:10.565998 run osmo-hlr_10.42.42.2(pid=2678): Launched 11:35:10.680357 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:11.210621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2680): Launched 11:35:11.509308 run osmo-stp_10.42.42.5(pid=2681): Launched 11:35:11.624253 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:12.163821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2683): Launched 11:35:12.462118 run osmo-msc_10.42.42.6(pid=2684): Launched 11:35:12.628624 run osmo-stp_10.42.42.5(pid=2681): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2681)] 11:35:12.754178 run osmo-stp_10.42.42.5(pid=2681): stdout: | (launched: 2022-12-10_11:35:11.455171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:12.880127 run osmo-stp_10.42.42.5(pid=2681): stderr: | 20221210113511624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113511624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113511625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113511625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113511626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113511626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113511626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:13.005319 run osmo-stp_10.42.42.5(pid=2681): stdout: | (launched: 2022-12-10_11:35:11.455171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:13.124374 run osmo-stp_10.42.42.5(pid=2681): stderr: | 20221210113511624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113511624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113511625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113511625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113511626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113511626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113511626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:13.266546 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2681): Process ended prematurely: osmo-stp_10.42.42.5(pid=2681) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2681)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:35:13.275358 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:35:13.302058 run osmo-hlr_10.42.42.2(pid=2678): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2678)] 11:35:13.349761 run osmo-hlr_10.42.42.2(pid=2678): stdout: | (launched: 2022-12-10_11:35:10.511289) 11:35:13.398820 run osmo-hlr_10.42.42.2(pid=2678): stderr: | 20221210113510688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113510688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113510688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113510688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113510688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113510688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113510700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113510709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113510709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113510709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:13.467101 run osmo-msc_10.42.42.6(pid=2684): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2684)] 11:35:13.514558 run osmo-msc_10.42.42.6(pid=2684): stdout: | (launched: 2022-12-10_11:35:12.407778) 11:35:13.563446 run osmo-msc_10.42.42.6(pid=2684): stderr: | 20221210113512678 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113512678 DLGLOBAL DEBUG validating counter group 0x7f0bddf73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113512678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113512678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113512678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113512679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113512681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113512681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113512681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113512681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:13.612929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2677): Terminating (SIGTERM) 11:35:13.652433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2680): Terminating (SIGTERM) 11:35:13.692007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2683): Terminating (SIGTERM) 11:35:13.731843 --- ParallelTerminationStrategy: PID 2677 died... 11:35:13.750767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2677): Terminated: ok {rc=0} 11:35:13.795154 --- ParallelTerminationStrategy: PID 2680 died... 11:35:13.813651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2680): Terminated: ok {rc=0} 11:35:13.858380 --- ParallelTerminationStrategy: PID 2683 died... 11:35:13.876978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2683): Terminated: ok {rc=0} 11:35:13.962932 bus /sierra_3: Setting Powered False 11:35:15.060019 bus /sierra_3: Setting Powered False 11:35:16.175573 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:35:17.429425 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:17.436040 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:35:17.469458 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:35:17.496641 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:35:17.551420 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:35:17.585274 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:35:17.612248 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:35:18.161635 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:35:18.212563 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:18.224282 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:35:18.294749 tst mo_mt_call.py: using LAC 28114 11:35:18.419626 tst mo_mt_call.py: using RAC 64 11:35:18.544283 tst mo_mt_call.py: using CellId 28114 11:35:18.669327 tst mo_mt_call.py: using BVCI 28115 11:35:18.786273 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:18.797710 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:18.808809 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:18.820111 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:18.831820 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:18.843051 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:35:18.956170 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:35:19.069986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:19.531975 run create_hlr_db(pid=2689): Launched 11:35:19.647655 bus /sierra_2: Setting Powered False 11:35:20.708698 run create_hlr_db(pid=2689): Terminated: ok {rc=0} 11:35:21.146910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2691): Launched 11:35:21.467431 run osmo-hlr_10.42.42.2(pid=2692): Launched 11:35:21.590016 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:22.143465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2694): Launched 11:35:22.463159 run osmo-stp_10.42.42.5(pid=2695): Launched 11:35:22.585170 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:23.165254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2697): Launched 11:35:23.485386 run osmo-msc_10.42.42.6(pid=2698): Launched 11:35:23.664028 run osmo-stp_10.42.42.5(pid=2695): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2695)] 11:35:23.799051 run osmo-stp_10.42.42.5(pid=2695): stdout: | (launched: 2022-12-10_11:35:22.405357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:23.934687 run osmo-stp_10.42.42.5(pid=2695): stderr: | 20221210113522596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113522596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113522596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113522597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113522599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113522599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113522599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:24.069325 run osmo-stp_10.42.42.5(pid=2695): stdout: | (launched: 2022-12-10_11:35:22.405357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:24.196910 run osmo-stp_10.42.42.5(pid=2695): stderr: | 20221210113522596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113522596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113522596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113522597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113522599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113522599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113522599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:24.350366 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2695): Process ended prematurely: osmo-stp_10.42.42.5(pid=2695) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2695)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:35:24.359713 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:35:24.387447 run osmo-hlr_10.42.42.2(pid=2692): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2692)] 11:35:24.437479 run osmo-hlr_10.42.42.2(pid=2692): stdout: | (launched: 2022-12-10_11:35:21.409734) 11:35:24.489233 run osmo-hlr_10.42.42.2(pid=2692): stderr: | 20221210113521606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113521606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113521606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113521606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113521606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113521606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113521619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113521627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113521627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113521627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:24.561106 run osmo-msc_10.42.42.6(pid=2698): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2698)] 11:35:24.610910 run osmo-msc_10.42.42.6(pid=2698): stdout: | (launched: 2022-12-10_11:35:23.427291) 11:35:24.662725 run osmo-msc_10.42.42.6(pid=2698): stderr: | 20221210113523749 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113523749 DLGLOBAL DEBUG validating counter group 0x7f2b8d9fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113523750 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113523750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113523750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113523750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113523752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113523752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113523752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113523752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:24.714441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2691): Terminating (SIGTERM) 11:35:24.755824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2694): Terminating (SIGTERM) 11:35:24.797299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2697): Terminating (SIGTERM) 11:35:24.838892 --- ParallelTerminationStrategy: PID 2691 died... 11:35:24.858398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2691): Terminated: ok {rc=0} 11:35:24.904240 --- ParallelTerminationStrategy: PID 2694 died... 11:35:24.923546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2694): Terminated: ok {rc=0} 11:35:24.969238 --- ParallelTerminationStrategy: PID 2697 died... 11:35:24.988454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2697): Terminated: ok {rc=0} 11:35:25.076689 bus /sierra_3: Setting Powered False 11:35:26.176440 bus /sierra_3: Setting Powered False 11:35:27.294783 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:35:28.440218 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:28.451970 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:35:28.522387 tst mo_mt_call_osmux.py: using LAC 28115 11:35:28.641370 tst mo_mt_call_osmux.py: using RAC 65 11:35:28.758949 tst mo_mt_call_osmux.py: using CellId 28115 11:35:28.876362 tst mo_mt_call_osmux.py: using BVCI 28116 11:35:28.986026 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:28.997149 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:29.007771 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:29.018952 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:29.030349 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:35:29.041772 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:35:29.160505 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:35:29.276352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:29.740284 run create_hlr_db(pid=2700): Launched 11:35:29.854957 bus /sierra_2: Setting Powered False 11:35:30.927303 run create_hlr_db(pid=2700): Terminated: ok {rc=0} 11:35:31.389418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2702): Launched 11:35:31.730539 run osmo-hlr_10.42.42.2(pid=2703): Launched 11:35:31.973236 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:32.588653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2705): Launched 11:35:32.909118 run osmo-stp_10.42.42.5(pid=2706): Launched 11:35:33.029084 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:33.574451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2708): Launched 11:35:33.874466 run osmo-msc_10.42.42.6(pid=2709): Launched 11:35:34.041799 run osmo-stp_10.42.42.5(pid=2706): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2706)] 11:35:34.168365 run osmo-stp_10.42.42.5(pid=2706): stdout: | (launched: 2022-12-10_11:35:32.850747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:34.295570 run osmo-stp_10.42.42.5(pid=2706): stderr: | 20221210113533021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113533021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113533022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113533022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113533023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113533023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113533023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:34.420664 run osmo-stp_10.42.42.5(pid=2706): stdout: | (launched: 2022-12-10_11:35:32.850747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:34.540530 run osmo-stp_10.42.42.5(pid=2706): stderr: | 20221210113533021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113533021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113533022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113533022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113533023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113533023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113533023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:34.683922 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2706): Process ended prematurely: osmo-stp_10.42.42.5(pid=2706) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2706)] [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:35:34.692920 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:35:34.719570 run osmo-hlr_10.42.42.2(pid=2703): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2703)] 11:35:34.767448 run osmo-hlr_10.42.42.2(pid=2703): stdout: | (launched: 2022-12-10_11:35:31.667863) 11:35:34.816673 run osmo-hlr_10.42.42.2(pid=2703): stderr: | 20221210113531954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113531954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113531954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113531954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113531954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113531955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113531971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113531987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113531987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113531987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:34.885748 run osmo-msc_10.42.42.6(pid=2709): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2709)] 11:35:34.933585 run osmo-msc_10.42.42.6(pid=2709): stdout: | (launched: 2022-12-10_11:35:33.819854) 11:35:34.982806 run osmo-msc_10.42.42.6(pid=2709): stderr: | 20221210113534092 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113534092 DLGLOBAL DEBUG validating counter group 0x7ff6d64dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113534092 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113534092 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113534092 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113534092 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113534094 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113534095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113534095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113534095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:35.032406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2702): Terminating (SIGTERM) 11:35:35.072048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2705): Terminating (SIGTERM) 11:35:35.111687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2708): Terminating (SIGTERM) 11:35:35.151855 --- ParallelTerminationStrategy: PID 2702 died... 11:35:35.170812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2702): Terminated: ok {rc=0} 11:35:35.215820 --- ParallelTerminationStrategy: PID 2705 died... 11:35:35.234179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2705): Terminated: ok {rc=0} 11:35:35.278306 --- ParallelTerminationStrategy: PID 2708 died... 11:35:35.296718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2708): Terminated: ok {rc=0} 11:35:35.381092 bus /sierra_3: Setting Powered False 11:35:36.479185 bus /sierra_3: Setting Powered False 11:35:37.596266 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:35:38.849661 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:38.856378 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:35:38.889761 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:35:38.916601 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:35:38.968558 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:35:39.002028 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:35:39.029108 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:35:39.585846 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:35:39.636796 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:39.648274 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:35:39.718564 tst mo_mt_call.py: using LAC 28116 11:35:39.843219 tst mo_mt_call.py: using RAC 66 11:35:39.968892 tst mo_mt_call.py: using CellId 28116 11:35:40.094937 tst mo_mt_call.py: using BVCI 28117 11:35:40.212630 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:40.224142 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:40.235853 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:40.247153 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:40.258510 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:40.269783 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:40.388847 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:40.503031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:40.965979 run create_hlr_db(pid=2714): Launched 11:35:41.080159 bus /sierra_2: Setting Powered False 11:35:42.139233 run create_hlr_db(pid=2714): Terminated: ok {rc=0} 11:35:42.575391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2716): Launched 11:35:42.894889 run osmo-hlr_10.42.42.2(pid=2717): Launched 11:35:43.016649 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:43.574272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2719): Launched 11:35:43.893376 run osmo-stp_10.42.42.5(pid=2720): Launched 11:35:44.015594 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:44.595564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2722): Launched 11:35:44.915005 run osmo-msc_10.42.42.6(pid=2723): Launched 11:35:45.092663 run osmo-stp_10.42.42.5(pid=2720): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2720)] 11:35:45.232747 run osmo-stp_10.42.42.5(pid=2720): stdout: | (launched: 2022-12-10_11:35:43.835730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:45.369593 run osmo-stp_10.42.42.5(pid=2720): stderr: | 20221210113544025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113544026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113544026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113544026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113544029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113544029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113544029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:45.502537 run osmo-stp_10.42.42.5(pid=2720): stdout: | (launched: 2022-12-10_11:35:43.835730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:45.630515 run osmo-stp_10.42.42.5(pid=2720): stderr: | 20221210113544025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113544026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113544026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113544026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113544029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113544029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113544029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:45.783254 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2720): Process ended prematurely: osmo-stp_10.42.42.5(pid=2720) [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2720)] [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:35:45.792703 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:35:45.820487 run osmo-hlr_10.42.42.2(pid=2717): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2717)] 11:35:45.876193 run osmo-hlr_10.42.42.2(pid=2717): stdout: | (launched: 2022-12-10_11:35:42.837236) 11:35:45.934756 run osmo-hlr_10.42.42.2(pid=2717): stderr: | 20221210113543035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113543035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113543035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113543035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113543035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113543035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113543047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113543055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113543055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113543055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:46.007223 run osmo-msc_10.42.42.6(pid=2723): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2723)] 11:35:46.057673 run osmo-msc_10.42.42.6(pid=2723): stdout: | (launched: 2022-12-10_11:35:44.857122) 11:35:46.110670 run osmo-msc_10.42.42.6(pid=2723): stderr: | 20221210113545181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113545181 DLGLOBAL DEBUG validating counter group 0x7f5dbcfc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113545181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113545181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113545182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113545182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113545184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113545185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113545185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113545185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:46.163981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2716): Terminating (SIGTERM) 11:35:46.206227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2719): Terminating (SIGTERM) 11:35:46.249055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2722): Terminating (SIGTERM) 11:35:46.293927 --- ParallelTerminationStrategy: PID 2716 died... 11:35:46.314513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2716): Terminated: ok {rc=0} 11:35:46.362207 --- ParallelTerminationStrategy: PID 2719 died... 11:35:46.382574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2719): Terminated: ok {rc=0} 11:35:46.429313 --- ParallelTerminationStrategy: PID 2722 died... 11:35:46.449167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2722): Terminated: ok {rc=0} 11:35:46.538355 bus /sierra_3: Setting Powered False 11:35:47.639075 bus /sierra_3: Setting Powered False 11:35:48.754769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:35:49.898681 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:49.910312 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:35:49.980258 tst mo_mt_call_osmux.py: using LAC 28117 11:35:50.097608 tst mo_mt_call_osmux.py: using RAC 67 11:35:50.221068 tst mo_mt_call_osmux.py: using CellId 28117 11:35:50.348181 tst mo_mt_call_osmux.py: using BVCI 28118 11:35:50.463771 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:50.475310 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:50.486556 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:50.497868 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:50.509221 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:35:50.520478 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:50.636392 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:50.754897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:51.251969 run create_hlr_db(pid=2725): Launched 11:35:51.382808 bus /sierra_2: Setting Powered False 11:35:52.446368 run create_hlr_db(pid=2725): Terminated: ok {rc=0} 11:35:52.874258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2727): Launched 11:35:53.175531 run osmo-hlr_10.42.42.2(pid=2728): Launched 11:35:53.290471 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:53.818853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2730): Launched 11:35:54.118004 run osmo-stp_10.42.42.5(pid=2731): Launched 11:35:54.232632 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:54.772810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2733): Launched 11:35:55.072539 run osmo-msc_10.42.42.6(pid=2734): Launched 11:35:55.241142 run osmo-stp_10.42.42.5(pid=2731): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2731)] 11:35:55.368822 run osmo-stp_10.42.42.5(pid=2731): stdout: | (launched: 2022-12-10_11:35:54.063912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:55.496528 run osmo-stp_10.42.42.5(pid=2731): stderr: | 20221210113554233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113554233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113554233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113554234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113554236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113554236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113554236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:55.620776 run osmo-stp_10.42.42.5(pid=2731): stdout: | (launched: 2022-12-10_11:35:54.063912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:55.739585 run osmo-stp_10.42.42.5(pid=2731): stderr: | 20221210113554233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113554233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113554233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113554234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113554236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113554236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113554236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:55.882418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2731): Process ended prematurely: osmo-stp_10.42.42.5(pid=2731) [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2731)] [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:35:55.891105 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:35:55.917902 run osmo-hlr_10.42.42.2(pid=2728): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2728)] 11:35:55.965539 run osmo-hlr_10.42.42.2(pid=2728): stdout: | (launched: 2022-12-10_11:35:53.120591) 11:35:56.014457 run osmo-hlr_10.42.42.2(pid=2728): stderr: | 20221210113553294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113553294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113553294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113553294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113553294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113553294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113553306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113553314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113553315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113553315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:56.082662 run osmo-msc_10.42.42.6(pid=2734): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2734)] 11:35:56.129750 run osmo-msc_10.42.42.6(pid=2734): stdout: | (launched: 2022-12-10_11:35:55.017993) 11:35:56.178427 run osmo-msc_10.42.42.6(pid=2734): stderr: | 20221210113555291 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113555291 DLGLOBAL DEBUG validating counter group 0x7f6b74ab8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113555291 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113555291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113555291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113555291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113555293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113555294 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113555294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113555294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:56.227646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2727): Terminating (SIGTERM) 11:35:56.266519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2730): Terminating (SIGTERM) 11:35:56.305401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2733): Terminating (SIGTERM) 11:35:56.345204 --- ParallelTerminationStrategy: PID 2727 died... 11:35:56.363777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2727): Terminated: ok {rc=0} 11:35:56.407195 --- ParallelTerminationStrategy: PID 2730 died... 11:35:56.425267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2730): Terminated: ok {rc=0} 11:35:56.469226 --- ParallelTerminationStrategy: PID 2733 died... 11:35:56.487522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2733): Terminated: ok {rc=0} 11:35:56.572877 bus /sierra_3: Setting Powered False 11:35:57.670138 bus /sierra_3: Setting Powered False 11:35:58.784652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:36:00.030242 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:00.037469 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:36:00.071222 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:36:00.098897 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:36:00.151795 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:36:00.185245 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:36:00.212483 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:36:00.763093 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:36:00.814222 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:00.825445 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:36:00.919228 tst mo_mt_call.py: using LAC 28118 11:36:01.060930 tst mo_mt_call.py: using RAC 68 11:36:01.183036 tst mo_mt_call.py: using CellId 28118 11:36:01.312582 tst mo_mt_call.py: using BVCI 28119 11:36:01.450250 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:01.461993 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:01.473903 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:01.485958 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:01.498246 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:01.510142 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:36:01.631098 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:36:01.779932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:02.272666 run create_hlr_db(pid=2739): Launched 11:36:02.403894 bus /sierra_2: Setting Powered False 11:36:03.468148 run create_hlr_db(pid=2739): Terminated: ok {rc=0} 11:36:03.897164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2741): Launched 11:36:04.197421 run osmo-hlr_10.42.42.2(pid=2742): Launched 11:36:04.313011 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:04.828059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2744): Launched 11:36:05.128586 run osmo-stp_10.42.42.5(pid=2745): Launched 11:36:05.244162 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:05.785784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2747): Launched 11:36:06.085650 run osmo-msc_10.42.42.6(pid=2748): Launched 11:36:06.254841 run osmo-stp_10.42.42.5(pid=2745): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2745)] 11:36:06.382499 run osmo-stp_10.42.42.5(pid=2745): stdout: | (launched: 2022-12-10_11:36:05.073661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:06.509409 run osmo-stp_10.42.42.5(pid=2745): stderr: | 20221210113605245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113605245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113605245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113605246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113605246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113605246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113605246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:06.634453 run osmo-stp_10.42.42.5(pid=2745): stdout: | (launched: 2022-12-10_11:36:05.073661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:06.753884 run osmo-stp_10.42.42.5(pid=2745): stderr: | 20221210113605245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113605245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113605245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113605246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113605246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113605246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113605246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:06.897309 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2745): Process ended prematurely: osmo-stp_10.42.42.5(pid=2745) [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2745)] [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:36:06.906336 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:36:06.933246 run osmo-hlr_10.42.42.2(pid=2742): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2742)] 11:36:06.981198 run osmo-hlr_10.42.42.2(pid=2742): stdout: | (launched: 2022-12-10_11:36:04.142664) 11:36:07.030659 run osmo-hlr_10.42.42.2(pid=2742): stderr: | 20221210113604318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113604318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113604318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113604318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113604318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113604318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113604330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113604339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113604339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113604340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:07.099427 run osmo-msc_10.42.42.6(pid=2748): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2748)] 11:36:07.147152 run osmo-msc_10.42.42.6(pid=2748): stdout: | (launched: 2022-12-10_11:36:06.030999) 11:36:07.196505 run osmo-msc_10.42.42.6(pid=2748): stderr: | 20221210113606300 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113606300 DLGLOBAL DEBUG validating counter group 0x7f38f69c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113606300 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113606300 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113606300 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113606300 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113606302 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113606303 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113606303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113606303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:07.246238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2741): Terminating (SIGTERM) 11:36:07.286314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2744): Terminating (SIGTERM) 11:36:07.326205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2747): Terminating (SIGTERM) 11:36:07.366382 --- ParallelTerminationStrategy: PID 2741 died... 11:36:07.385446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2741): Terminated: ok {rc=0} 11:36:07.429879 --- ParallelTerminationStrategy: PID 2744 died... 11:36:07.448351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2744): Terminated: ok {rc=0} 11:36:07.492683 --- ParallelTerminationStrategy: PID 2747 died... 11:36:07.511385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2747): Terminated: ok {rc=0} 11:36:07.598292 bus /sierra_3: Setting Powered False 11:36:08.697697 bus /sierra_3: Setting Powered False 11:36:09.814597 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:36:10.960278 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:10.971896 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:36:11.042143 tst mo_mt_call_osmux.py: using LAC 28119 11:36:11.161384 tst mo_mt_call_osmux.py: using RAC 69 11:36:11.280425 tst mo_mt_call_osmux.py: using CellId 28119 11:36:11.396822 tst mo_mt_call_osmux.py: using BVCI 28120 11:36:11.504925 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:11.515860 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:11.526651 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:11.537772 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:11.548595 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:36:11.559643 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:36:11.677395 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:36:11.793892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:12.289400 run create_hlr_db(pid=2750): Launched 11:36:12.421201 bus /sierra_2: Setting Powered False 11:36:13.485142 run create_hlr_db(pid=2750): Terminated: ok {rc=0} 11:36:13.913713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2752): Launched 11:36:14.213683 run osmo-hlr_10.42.42.2(pid=2753): Launched 11:36:14.328345 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:14.855387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2755): Launched 11:36:15.155356 run osmo-stp_10.42.42.5(pid=2756): Launched 11:36:15.269369 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:15.810529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2758): Launched 11:36:16.185448 run osmo-msc_10.42.42.6(pid=2759): Launched 11:36:16.581690 run osmo-stp_10.42.42.5(pid=2756): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2756)] 11:36:16.845971 run osmo-stp_10.42.42.5(pid=2756): stdout: | (launched: 2022-12-10_11:36:15.100819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:16.982788 run osmo-stp_10.42.42.5(pid=2756): stderr: | 20221210113615272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113615273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113615273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113615273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113615274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113615274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113615274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:17.110262 run osmo-stp_10.42.42.5(pid=2756): stdout: | (launched: 2022-12-10_11:36:15.100819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:17.232188 run osmo-stp_10.42.42.5(pid=2756): stderr: | 20221210113615272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113615273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113615273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113615273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113615274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113615274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113615274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:17.375444 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2756): Process ended prematurely: osmo-stp_10.42.42.5(pid=2756) [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2756)] [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:36:17.384418 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:36:17.411157 run osmo-hlr_10.42.42.2(pid=2753): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2753)] 11:36:17.458929 run osmo-hlr_10.42.42.2(pid=2753): stdout: | (launched: 2022-12-10_11:36:14.158722) 11:36:17.508184 run osmo-hlr_10.42.42.2(pid=2753): stderr: | 20221210113614334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113614334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113614334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113614334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113614334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113614334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113614346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113614355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113614355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113614355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:17.576704 run osmo-msc_10.42.42.6(pid=2759): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2759)] 11:36:17.624262 run osmo-msc_10.42.42.6(pid=2759): stdout: | (launched: 2022-12-10_11:36:16.119339) 11:36:17.673269 run osmo-msc_10.42.42.6(pid=2759): stderr: | 20221210113616556 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113616556 DLGLOBAL DEBUG validating counter group 0x7fc1fb0adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113616556 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113616556 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113616565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113616565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113616567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113616567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113616567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113616567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:17.722701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2752): Terminating (SIGTERM) 11:36:17.762121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2755): Terminating (SIGTERM) 11:36:17.801715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2758): Terminating (SIGTERM) 11:36:17.841361 --- ParallelTerminationStrategy: PID 2752 died... 11:36:17.860348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2752): Terminated: ok {rc=0} 11:36:17.904565 --- ParallelTerminationStrategy: PID 2755 died... 11:36:17.923167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2755): Terminated: ok {rc=0} 11:36:17.967161 --- ParallelTerminationStrategy: PID 2758 died... 11:36:17.985762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2758): Terminated: ok {rc=0} 11:36:18.071444 bus /sierra_3: Setting Powered False 11:36:19.169431 bus /sierra_3: Setting Powered False 11:36:20.285349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 11:36:21.534583 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:21.539462 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 11:36:21.573006 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 11:36:21.599404 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 11:36:21.651181 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 11:36:21.683724 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 11:36:21.709722 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 11:36:22.257543 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 11:36:22.306019 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:22.316833 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:36:22.366877 tst mo_mt_call.py: using LAC 28120 11:36:22.485895 tst mo_mt_call.py: using RAC 70 11:36:22.602691 tst mo_mt_call.py: using CellId 28120 11:36:22.724822 tst mo_mt_call.py: using BVCI 28121 11:36:22.834234 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:22.845079 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:22.855600 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:22.866411 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:22.877292 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:22.888072 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:36:23.003812 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:36:23.117715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:23.582646 run create_hlr_db(pid=2764): Launched 11:36:23.698200 bus /sierra_2: Setting Powered False 11:36:24.758050 run create_hlr_db(pid=2764): Terminated: ok {rc=0} 11:36:25.196434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2766): Launched 11:36:25.517668 run osmo-hlr_10.42.42.2(pid=2767): Launched 11:36:25.641923 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:26.192941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2769): Launched 11:36:26.514181 run osmo-stp_10.42.42.5(pid=2770): Launched 11:36:26.637425 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:27.215702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2772): Launched 11:36:27.536674 run osmo-msc_10.42.42.6(pid=2773): Launched 11:36:27.716430 run osmo-stp_10.42.42.5(pid=2770): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2770)] 11:36:27.851293 run osmo-stp_10.42.42.5(pid=2770): stdout: | (launched: 2022-12-10_11:36:26.456253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:27.987697 run osmo-stp_10.42.42.5(pid=2770): stderr: | 20221210113626648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113626648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113626648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113626649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113626649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113626649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113626649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:28.122041 run osmo-stp_10.42.42.5(pid=2770): stdout: | (launched: 2022-12-10_11:36:26.456253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:28.250102 run osmo-stp_10.42.42.5(pid=2770): stderr: | 20221210113626648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113626648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113626648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113626649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113626649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113626649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113626649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:28.403192 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2770): Process ended prematurely: osmo-stp_10.42.42.5(pid=2770) [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2770)] [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 11:36:28.412459 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:36:28.440308 run osmo-hlr_10.42.42.2(pid=2767): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2767)] 11:36:28.490416 run osmo-hlr_10.42.42.2(pid=2767): stdout: | (launched: 2022-12-10_11:36:25.459975) 11:36:28.541729 run osmo-hlr_10.42.42.2(pid=2767): stderr: | 20221210113625657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113625657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113625657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113625657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113625657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113625657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113625681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113625692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113625693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113625693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:28.613690 run osmo-msc_10.42.42.6(pid=2773): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2773)] 11:36:28.663611 run osmo-msc_10.42.42.6(pid=2773): stdout: | (launched: 2022-12-10_11:36:27.478362) 11:36:28.714825 run osmo-msc_10.42.42.6(pid=2773): stderr: | 20221210113627800 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113627800 DLGLOBAL DEBUG validating counter group 0x7f4ba2702c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113627801 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113627801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113627801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113627801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113627803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113627803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113627803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113627803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:28.766684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2766): Terminating (SIGTERM) 11:36:28.807902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2769): Terminating (SIGTERM) 11:36:28.849415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2772): Terminating (SIGTERM) 11:36:28.890885 --- ParallelTerminationStrategy: PID 2766 died... 11:36:28.910177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2766): Terminated: ok {rc=0} 11:36:28.955881 --- ParallelTerminationStrategy: PID 2769 died... 11:36:28.975138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2769): Terminated: ok {rc=0} 11:36:29.020433 --- ParallelTerminationStrategy: PID 2772 died... 11:36:29.039757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2772): Terminated: ok {rc=0} 11:36:29.127360 bus /sierra_3: Setting Powered False 11:36:30.225906 bus /sierra_3: Setting Powered False 11:36:31.341386 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 11:36:32.488087 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:32.499736 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:36:32.550149 tst mo_mt_call_osmux.py: using LAC 28121 11:36:32.667830 tst mo_mt_call_osmux.py: using RAC 71 11:36:32.785703 tst mo_mt_call_osmux.py: using CellId 28121 11:36:32.902766 tst mo_mt_call_osmux.py: using BVCI 28122 11:36:33.010503 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:33.021579 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:33.032084 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:33.042949 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:33.053871 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:36:33.064593 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:36:33.177892 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:36:33.291517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:33.753274 run create_hlr_db(pid=2775): Launched 11:36:33.867088 bus /sierra_2: Setting Powered False 11:36:34.927183 run create_hlr_db(pid=2775): Terminated: ok {rc=0} 11:36:35.365278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2777): Launched 11:36:35.686530 run osmo-hlr_10.42.42.2(pid=2778): Launched 11:36:35.808782 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:36.364199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2780): Launched 11:36:36.686145 run osmo-stp_10.42.42.5(pid=2781): Launched 11:36:36.809048 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:37.389644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2783): Launched 11:36:37.709730 run osmo-msc_10.42.42.6(pid=2784): Launched 11:36:37.888236 run osmo-stp_10.42.42.5(pid=2781): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2781)] 11:36:38.023476 run osmo-stp_10.42.42.5(pid=2781): stdout: | (launched: 2022-12-10_11:36:36.627961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:38.159126 run osmo-stp_10.42.42.5(pid=2781): stderr: | 20221210113636819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113636819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113636819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113636820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113636820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113636820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113636820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:38.294388 run osmo-stp_10.42.42.5(pid=2781): stdout: | (launched: 2022-12-10_11:36:36.627961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:38.422628 run osmo-stp_10.42.42.5(pid=2781): stderr: | 20221210113636819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113636819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113636819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113636820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113636820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113636820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113636820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:38.576197 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2781): Process ended prematurely: osmo-stp_10.42.42.5(pid=2781) [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2781)] [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 11:36:38.585714 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:36:38.613353 run osmo-hlr_10.42.42.2(pid=2778): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2778)] 11:36:38.663402 run osmo-hlr_10.42.42.2(pid=2778): stdout: | (launched: 2022-12-10_11:36:35.628431) 11:36:38.715160 run osmo-hlr_10.42.42.2(pid=2778): stderr: | 20221210113635827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113635827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113635827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113635827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113635827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113635827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113635840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113635848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113635848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113635848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:38.787069 run osmo-msc_10.42.42.6(pid=2784): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2784)] 11:36:38.837272 run osmo-msc_10.42.42.6(pid=2784): stdout: | (launched: 2022-12-10_11:36:37.651699) 11:36:38.889075 run osmo-msc_10.42.42.6(pid=2784): stderr: | 20221210113637976 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113637976 DLGLOBAL DEBUG validating counter group 0x7f4d4e75bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113637976 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113637976 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113637976 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113637976 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113637978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113637979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113637979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113637979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:38.941318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2777): Terminating (SIGTERM) 11:36:38.982869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2780): Terminating (SIGTERM) 11:36:39.024431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2783): Terminating (SIGTERM) 11:36:39.066366 --- ParallelTerminationStrategy: PID 2777 died... 11:36:39.085808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2777): Terminated: ok {rc=0} 11:36:39.131843 --- ParallelTerminationStrategy: PID 2780 died... 11:36:39.151229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2780): Terminated: ok {rc=0} 11:36:39.196932 --- ParallelTerminationStrategy: PID 2783 died... 11:36:39.216420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2783): Terminated: ok {rc=0} 11:36:39.303912 bus /sierra_3: Setting Powered False 11:36:40.403962 bus /sierra_3: Setting Powered False 11:36:41.518503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:36:42.771790 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:42.778977 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:36:42.812699 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:36:42.839197 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:36:42.891498 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:36:42.925469 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:36:42.952470 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:36:43.504068 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:36:43.555476 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:43.567329 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:36:43.621684 tst mo_mt_call.py: using LAC 28122 11:36:43.747817 tst mo_mt_call.py: using RAC 72 11:36:43.872521 tst mo_mt_call.py: using CellId 28122 11:36:43.990415 tst mo_mt_call.py: using BVCI 28123 11:36:44.100595 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:44.111819 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:44.122767 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:44.133974 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:44.145273 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:44.156358 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:36:44.277189 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:36:44.395661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:44.895157 run create_hlr_db(pid=2789): Launched 11:36:45.027071 bus /sierra_2: Setting Powered False 11:36:46.088320 run create_hlr_db(pid=2789): Terminated: ok {rc=0} 11:36:46.565616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2791): Launched 11:36:47.000421 run osmo-hlr_10.42.42.2(pid=2792): Launched 11:36:47.243053 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:47.853579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2794): Launched 11:36:48.154594 run osmo-stp_10.42.42.5(pid=2795): Launched 11:36:48.269350 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:48.813631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2797): Launched 11:36:49.114925 run osmo-msc_10.42.42.6(pid=2798): Launched 11:36:49.284458 run osmo-stp_10.42.42.5(pid=2795): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2795)] 11:36:49.412774 run osmo-stp_10.42.42.5(pid=2795): stdout: | (launched: 2022-12-10_11:36:48.099548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:49.540366 run osmo-stp_10.42.42.5(pid=2795): stderr: | 20221210113648269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113648269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113648269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113648270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113648270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113648270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113648270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:49.665651 run osmo-stp_10.42.42.5(pid=2795): stdout: | (launched: 2022-12-10_11:36:48.099548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:49.785649 run osmo-stp_10.42.42.5(pid=2795): stderr: | 20221210113648269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113648269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113648269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113648270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113648270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113648270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113648270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:49.929345 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2795): Process ended prematurely: osmo-stp_10.42.42.5(pid=2795) [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2795)] [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:36:49.938218 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:36:49.965301 run osmo-hlr_10.42.42.2(pid=2792): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2792)] 11:36:50.013405 run osmo-hlr_10.42.42.2(pid=2792): stdout: | (launched: 2022-12-10_11:36:46.925370) 11:36:50.063053 run osmo-hlr_10.42.42.2(pid=2792): stderr: | 20221210113647170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113647170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113647170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113647170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113647170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113647170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113647184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113647215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113647215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113647215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:50.132471 run osmo-msc_10.42.42.6(pid=2798): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2798)] 11:36:50.180661 run osmo-msc_10.42.42.6(pid=2798): stdout: | (launched: 2022-12-10_11:36:49.059718) 11:36:50.230404 run osmo-msc_10.42.42.6(pid=2798): stderr: | 20221210113649329 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113649329 DLGLOBAL DEBUG validating counter group 0x7fdeaa7d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113649330 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113649330 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113649330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113649330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113649332 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113649332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113649332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113649332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:50.280340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2791): Terminating (SIGTERM) 11:36:50.320591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2794): Terminating (SIGTERM) 11:36:50.360710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2797): Terminating (SIGTERM) 11:36:50.401112 --- ParallelTerminationStrategy: PID 2791 died... 11:36:50.420091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2791): Terminated: ok {rc=0} 11:36:50.464714 --- ParallelTerminationStrategy: PID 2794 died... 11:36:50.483334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2794): Terminated: ok {rc=0} 11:36:50.528399 --- ParallelTerminationStrategy: PID 2797 died... 11:36:50.547073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2797): Terminated: ok {rc=0} 11:36:50.634160 bus /sierra_3: Setting Powered False 11:36:51.735000 bus /sierra_3: Setting Powered False 11:36:52.852033 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:36:53.999270 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:54.011047 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:36:54.063802 tst mo_mt_call_osmux.py: using LAC 28123 11:36:54.181601 tst mo_mt_call_osmux.py: using RAC 73 11:36:54.301129 tst mo_mt_call_osmux.py: using CellId 28123 11:36:54.428483 tst mo_mt_call_osmux.py: using BVCI 28124 11:36:54.545437 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:54.557227 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:54.568831 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:54.581215 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:54.593487 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:36:54.605412 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:36:54.725458 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:36:54.846902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:55.345656 run create_hlr_db(pid=2800): Launched 11:36:55.476794 bus /sierra_2: Setting Powered False 11:36:56.540675 run create_hlr_db(pid=2800): Terminated: ok {rc=0} 11:36:56.969795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2802): Launched 11:36:57.270410 run osmo-hlr_10.42.42.2(pid=2803): Launched 11:36:57.385729 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:57.898911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Launched 11:36:58.198341 run osmo-stp_10.42.42.5(pid=2806): Launched 11:36:58.312117 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:58.852907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Launched 11:36:59.151846 run osmo-msc_10.42.42.6(pid=2809): Launched 11:36:59.318836 run osmo-stp_10.42.42.5(pid=2806): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] 11:36:59.445687 run osmo-stp_10.42.42.5(pid=2806): stdout: | (launched: 2022-12-10_11:36:58.144070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:59.572378 run osmo-stp_10.42.42.5(pid=2806): stderr: | 20221210113658312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113658312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113658313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113658313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113658315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113658316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113658316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:59.696475 run osmo-stp_10.42.42.5(pid=2806): stdout: | (launched: 2022-12-10_11:36:58.144070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:59.815591 run osmo-stp_10.42.42.5(pid=2806): stderr: | 20221210113658312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113658312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113658313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113658313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113658315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113658316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113658316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:59.958576 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2806): Process ended prematurely: osmo-stp_10.42.42.5(pid=2806) [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:36:59.967324 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:36:59.993908 run osmo-hlr_10.42.42.2(pid=2803): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2803)] 11:37:00.041166 run osmo-hlr_10.42.42.2(pid=2803): stdout: | (launched: 2022-12-10_11:36:57.215560) 11:37:00.090182 run osmo-hlr_10.42.42.2(pid=2803): stderr: | 20221210113657393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113657393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113657393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113657393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113657393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113657393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113657405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113657414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113657414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113657414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:00.158724 run osmo-msc_10.42.42.6(pid=2809): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2809)] 11:37:00.206239 run osmo-msc_10.42.42.6(pid=2809): stdout: | (launched: 2022-12-10_11:36:59.097399) 11:37:00.255233 run osmo-msc_10.42.42.6(pid=2809): stderr: | 20221210113659369 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113659369 DLGLOBAL DEBUG validating counter group 0x7f7580307c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113659370 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113659370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113659370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113659370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113659372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113659372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113659372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113659372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:00.304628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2802): Terminating (SIGTERM) 11:37:00.344610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Terminating (SIGTERM) 11:37:00.384131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Terminating (SIGTERM) 11:37:00.423847 --- ParallelTerminationStrategy: PID 2802 died... 11:37:00.442650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2802): Terminated: ok {rc=0} 11:37:00.486407 --- ParallelTerminationStrategy: PID 2805 died... 11:37:00.504749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Terminated: ok {rc=0} 11:37:00.548514 --- ParallelTerminationStrategy: PID 2808 died... 11:37:00.566859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Terminated: ok {rc=0} 11:37:00.651977 bus /sierra_3: Setting Powered False 11:37:01.750942 bus /sierra_3: Setting Powered False 11:37:02.867228 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:trx-b200 --------------------------------------------------------------------- 11:37:04.122599 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:04.127616 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 11:37:04.161784 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:37:04.188782 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 11:37:04.275869 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 11:37:04.308554 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:37:04.334820 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 11:37:04.915002 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 11:37:04.920141 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:04.930847 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:37:04.982965 tst emergency_mo_mt_call.py: using LAC 28124 11:37:05.098753 tst emergency_mo_mt_call.py: using RAC 74 11:37:05.212017 tst emergency_mo_mt_call.py: using CellId 28124 11:37:05.325354 tst emergency_mo_mt_call.py: using BVCI 28125 11:37:05.431456 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:05.442060 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:05.452346 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:05.462908 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:05.473814 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:05.484503 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:37:05.601622 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:37:05.718180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:06.206907 run create_hlr_db(pid=2815): Launched 11:37:06.337446 bus /sierra_2: Setting Powered False 11:37:07.399932 run create_hlr_db(pid=2815): Terminated: ok {rc=0} 11:37:07.822402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2817): Launched 11:37:08.116518 run osmo-hlr_10.42.42.2(pid=2818): Launched 11:37:08.229386 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:08.751809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2820): Launched 11:37:09.046589 run osmo-stp_10.42.42.5(pid=2821): Launched 11:37:09.169483 tst emergency_mo_mt_call.py: using MSISDN 7716 11:37:09.319832 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:09.848616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2823): Launched 11:37:10.142332 run osmo-msc_10.42.42.6(pid=2824): Launched 11:37:10.307118 run osmo-stp_10.42.42.5(pid=2821): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2821)] 11:37:10.431073 run osmo-stp_10.42.42.5(pid=2821): stdout: | (launched: 2022-12-10_11:37:08.992864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:10.555980 run osmo-stp_10.42.42.5(pid=2821): stderr: | 20221210113709161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113709161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113709161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113709163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113709163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113709163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113709163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:10.678212 run osmo-stp_10.42.42.5(pid=2821): stdout: | (launched: 2022-12-10_11:37:08.992864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:10.795944 run osmo-stp_10.42.42.5(pid=2821): stderr: | 20221210113709161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113709161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113709161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113709163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113709163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113709163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113709163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:10.936302 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2821): Process ended prematurely: osmo-stp_10.42.42.5(pid=2821) [trial-2374↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2821)] [trial-2374↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 11:37:10.944663 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 11:37:10.971111 run osmo-hlr_10.42.42.2(pid=2818): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2818)] 11:37:11.018764 run osmo-hlr_10.42.42.2(pid=2818): stdout: | (launched: 2022-12-10_11:37:08.062531) 11:37:11.067871 run osmo-hlr_10.42.42.2(pid=2818): stderr: | 20221210113708238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113708238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113708238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113708238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113708238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113708238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113708250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113708259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113708259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113708259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:11.136135 run osmo-msc_10.42.42.6(pid=2824): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2824)] 11:37:11.183588 run osmo-msc_10.42.42.6(pid=2824): stdout: | (launched: 2022-12-10_11:37:10.088281) 11:37:11.232359 run osmo-msc_10.42.42.6(pid=2824): stderr: | 20221210113710361 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113710361 DLGLOBAL DEBUG validating counter group 0x7fd1066b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113710361 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113710361 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113710361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113710361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113710363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113710364 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113710364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113710364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:11.281713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2817): Terminating (SIGTERM) 11:37:11.320817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2820): Terminating (SIGTERM) 11:37:11.360234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2823): Terminating (SIGTERM) 11:37:11.400019 --- ParallelTerminationStrategy: PID 2817 died... 11:37:11.419011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2817): Terminated: ok {rc=0} 11:37:11.463922 --- ParallelTerminationStrategy: PID 2820 died... 11:37:11.482352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2820): Terminated: ok {rc=0} 11:37:11.526247 --- ParallelTerminationStrategy: PID 2823 died... 11:37:11.544657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2823): Terminated: ok {rc=0} 11:37:11.628725 bus /sierra_3: Setting Powered False 11:37:12.727030 bus /sierra_3: Setting Powered False 11:37:13.843079 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 11:37:14.930320 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:14.942221 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:37:14.995874 tst emergency_preemptive_call.py: using LAC 28125 11:37:15.121386 tst emergency_preemptive_call.py: using RAC 75 11:37:15.244816 tst emergency_preemptive_call.py: using CellId 28125 11:37:15.372275 tst emergency_preemptive_call.py: using BVCI 28126 11:37:15.487475 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:15.498725 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:15.509592 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:15.520844 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:15.532623 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:37:15.543882 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:37:15.661705 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:37:15.775324 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:37:15.892801 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:37:16.013904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:16.519935 run create_hlr_db(pid=2826): Launched 11:37:16.681566 bus /sierra_2: Setting Powered False 11:37:17.743766 run create_hlr_db(pid=2826): Terminated: ok {rc=0} 11:37:18.173718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Launched 11:37:18.468428 run osmo-hlr_10.42.42.2(pid=2829): Launched 11:37:18.581147 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:19.087554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Launched 11:37:19.381416 run osmo-stp_10.42.42.5(pid=2832): Launched 11:37:19.503728 tst emergency_preemptive_call.py: using MSISDN 7717 11:37:19.666898 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:20.193344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2834): Launched 11:37:20.487553 run osmo-msc_10.42.42.6(pid=2835): Launched 11:37:20.653126 run osmo-stp_10.42.42.5(pid=2832): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] 11:37:20.777212 run osmo-stp_10.42.42.5(pid=2832): stdout: | (launched: 2022-12-10_11:37:19.327349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:20.902931 run osmo-stp_10.42.42.5(pid=2832): stderr: | 20221210113719499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113719500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113719500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113719501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113719501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113719501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113719501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:21.024732 run osmo-stp_10.42.42.5(pid=2832): stdout: | (launched: 2022-12-10_11:37:19.327349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:21.142228 run osmo-stp_10.42.42.5(pid=2832): stderr: | 20221210113719499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113719500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113719500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113719501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113719501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113719501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113719501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:21.282268 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2832): Process ended prematurely: osmo-stp_10.42.42.5(pid=2832) [trial-2374↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] [trial-2374↪emergency:trx-b200↪emergency_preemptive_call.py:32] 11:37:21.290491 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 11:37:21.317121 run osmo-hlr_10.42.42.2(pid=2829): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2829)] 11:37:21.364835 run osmo-hlr_10.42.42.2(pid=2829): stdout: | (launched: 2022-12-10_11:37:18.414537) 11:37:21.414253 run osmo-hlr_10.42.42.2(pid=2829): stderr: | 20221210113718591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113718591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113718592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113718592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113718592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113718592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113718604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113718612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113718612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113718612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:21.483114 run osmo-msc_10.42.42.6(pid=2835): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2835)] 11:37:21.531007 run osmo-msc_10.42.42.6(pid=2835): stdout: | (launched: 2022-12-10_11:37:20.434045) 11:37:21.580354 run osmo-msc_10.42.42.6(pid=2835): stderr: | 20221210113720707 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210113720708 DLGLOBAL DEBUG validating counter group 0x7f9cc3876c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210113720708 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210113720708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210113720708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210113720708 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210113720710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210113720710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210113720710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210113720711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:21.629969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Terminating (SIGTERM) 11:37:21.669573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Terminating (SIGTERM) 11:37:21.709473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2834): Terminating (SIGTERM) 11:37:21.749585 --- ParallelTerminationStrategy: PID 2828 died... 11:37:21.768496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Terminated: ok {rc=0} 11:37:21.813012 --- ParallelTerminationStrategy: PID 2831 died... 11:37:21.831686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Terminated: ok {rc=0} 11:37:21.875870 --- ParallelTerminationStrategy: PID 2834 died... 11:37:21.894407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2834): Terminated: ok {rc=0} 11:37:21.980552 bus /sierra_9: Setting Powered False 11:37:23.080824 bus /sierra_9: Setting Powered False 11:37:24.196572 bus /sierra_8: Setting Powered False 11:37:25.297222 bus /sierra_8: Setting Powered False 11:37:26.413430 bus /sierra_3: Setting Powered False 11:37:27.512554 bus /sierra_3: Setting Powered False 11:37:28.630160 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-b200 --------------------------------------------------------------------- 11:37:29.913878 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:29.918379 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 11:37:29.951944 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 11:37:29.990878 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 11:37:30.078592 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 11:37:30.111739 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 11:37:30.150491 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 11:37:30.741958 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 11:37:30.793926 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:30.804700 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:37:30.857285 tst cs_paging_gprs_active.py: using LAC 28126 11:37:30.990965 tst cs_paging_gprs_active.py: using RAC 76 11:37:31.128230 tst cs_paging_gprs_active.py: using CellId 28126 11:37:31.256710 tst cs_paging_gprs_active.py: using BVCI 28127 11:37:31.370121 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.381833 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.394214 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.406616 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.418432 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.430290 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.444248 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.455450 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:31.467637 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:37:31.616767 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:37:31.759481 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:37:31.992032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:37:32.326012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Launched 11:37:32.610645 run iperf3-srv_10.42.42.10(pid=2841): Launched 11:37:32.731874 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:37:32.949369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:37:33.273064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Launched 11:37:33.554116 run iperf3-srv_10.42.42.10(pid=2843): Launched 11:37:33.674490 tst cs_paging_gprs_active.py:38: start network... 11:37:33.891833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:34.392048 run create_hlr_db(pid=2844): Launched 11:37:34.523651 bus /sierra_2: Setting Powered False 11:37:35.587900 run create_hlr_db(pid=2844): Terminated: ok {rc=0} 11:37:36.037113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2851): Launched 11:37:36.359825 run osmo-hlr_10.42.42.2(pid=2852): Launched 11:37:36.482420 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:37.035163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2854): Launched 11:37:37.357737 run osmo-stp_10.42.42.5(pid=2855): Launched 11:37:37.480592 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:37:38.035816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2857): Launched 11:37:38.159524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:37:38.432007 run patchelf(pid=2858): Launched 11:37:38.611117 run osmo-stp_10.42.42.5(pid=2855): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2855)] 11:37:38.747749 run osmo-stp_10.42.42.5(pid=2855): stdout: | (launched: 2022-12-10_11:37:37.299517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:38.886218 run osmo-stp_10.42.42.5(pid=2855): stderr: | 20221210113737492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113737492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113737492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113737493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113737493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113737493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113737493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:39.025162 run osmo-stp_10.42.42.5(pid=2855): stdout: | (launched: 2022-12-10_11:37:37.299517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:39.157244 run osmo-stp_10.42.42.5(pid=2855): stderr: | 20221210113737492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113737492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113737492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113737493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113737493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113737493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113737493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:39.314492 run patchelf(pid=2858): Terminating (SIGINT) 11:37:39.494885 run patchelf(pid=2858): Terminated: ok {rc=0} 11:37:39.624741 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2855): Process ended prematurely: osmo-stp_10.42.42.5(pid=2855) [trial-2374↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2855)] [trial-2374↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 11:37:39.634868 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:37:39.663076 run osmo-hlr_10.42.42.2(pid=2852): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2852)] 11:37:39.712671 run osmo-hlr_10.42.42.2(pid=2852): stdout: | (launched: 2022-12-10_11:37:36.301238) 11:37:39.764121 run osmo-hlr_10.42.42.2(pid=2852): stderr: | 20221210113736499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113736499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113736500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113736500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113736500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113736500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113736511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113736520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113736520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113736520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:39.815809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Terminating (SIGTERM) 11:37:39.857411 run iperf3-srv_10.42.42.10(pid=2841): Terminating (SIGTERM) 11:37:39.899156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Terminating (SIGTERM) 11:37:39.940794 run iperf3-srv_10.42.42.10(pid=2843): Terminating (SIGTERM) 11:37:39.982438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2851): Terminating (SIGTERM) 11:37:40.024227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2854): Terminating (SIGTERM) 11:37:40.066093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2857): Terminating (SIGTERM) 11:37:40.108015 --- ParallelTerminationStrategy: PID 2840 died... 11:37:40.128015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Terminated: ok {rc=0} 11:37:40.174270 --- ParallelTerminationStrategy: PID 2841 died... 11:37:40.193767 run iperf3-srv_10.42.42.10(pid=2841): Terminated {rc=256} 11:37:40.239723 --- ParallelTerminationStrategy: PID 2842 died... 11:37:40.259190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Terminated: ok {rc=0} 11:37:40.305452 --- ParallelTerminationStrategy: PID 2843 died... 11:37:40.324791 run iperf3-srv_10.42.42.10(pid=2843): Terminated {rc=256} 11:37:40.370892 --- ParallelTerminationStrategy: PID 2851 died... 11:37:40.390427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2851): Terminated: ok {rc=0} 11:37:40.436312 --- ParallelTerminationStrategy: PID 2854 died... 11:37:40.455903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2854): Terminated: ok {rc=0} 11:37:40.501986 --- ParallelTerminationStrategy: PID 2857 died... 11:37:40.521478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2857): Terminated: ok {rc=0} 11:37:40.610712 bus /gobi_0: Setting Powered False 11:37:41.710736 bus /gobi_0: Setting Powered False 11:37:42.826223 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200 iperf3.py ---------------------------------------------- 11:37:43.969602 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:43.980603 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:37:44.035556 tst iperf3.py: using LAC 28127 11:37:44.152627 tst iperf3.py: using RAC 77 11:37:44.269888 tst iperf3.py: using CellId 28127 11:37:44.388083 tst iperf3.py: using BVCI 28128 11:37:44.506265 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.517451 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.528385 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.539340 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.550011 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.560790 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.571807 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.582465 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:44.593452 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:37:44.710400 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:37:44.928225 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:37:45.251159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2859): Launched 11:37:45.531747 run iperf3-srv_10.42.42.10(pid=2860): Launched 11:37:45.652716 tst iperf3.py:8: start network... 11:37:45.870660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:46.381066 run create_hlr_db(pid=2861): Launched 11:37:46.538262 bus /gobi_6: Setting Powered False 11:37:47.597526 run create_hlr_db(pid=2861): Terminated: ok {rc=0} 11:37:48.104018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2863): Launched 11:37:48.426665 run osmo-hlr_10.42.42.2(pid=2864): Launched 11:37:48.549080 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:49.107028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2866): Launched 11:37:49.429082 run osmo-stp_10.42.42.5(pid=2867): Launched 11:37:49.552157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:37:50.108148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2869): Launched 11:37:50.231317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:37:50.502760 run patchelf(pid=2870): Launched 11:37:50.681879 run osmo-stp_10.42.42.5(pid=2867): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2867)] 11:37:50.818184 run osmo-stp_10.42.42.5(pid=2867): stdout: | (launched: 2022-12-10_11:37:49.370729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:50.956000 run osmo-stp_10.42.42.5(pid=2867): stderr: | 20221210113749563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113749563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113749564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113749564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113749564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113749565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113749565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:51.094425 run osmo-stp_10.42.42.5(pid=2867): stdout: | (launched: 2022-12-10_11:37:49.370729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:51.227163 run osmo-stp_10.42.42.5(pid=2867): stderr: | 20221210113749563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113749563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113749564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113749564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113749564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113749565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113749565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:51.384131 run patchelf(pid=2870): Terminating (SIGINT) 11:37:51.564648 run patchelf(pid=2870): Terminated: ok {rc=0} 11:37:51.694772 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2867): Process ended prematurely: osmo-stp_10.42.42.5(pid=2867) [trial-2374↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2867)] [trial-2374↪gprs:trx-b200↪iperf3.py:8] 11:37:51.704710 tst iperf3.py:8: Test FAILED (7.8 sec) 11:37:51.733299 run osmo-hlr_10.42.42.2(pid=2864): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2864)] 11:37:51.783315 run osmo-hlr_10.42.42.2(pid=2864): stdout: | (launched: 2022-12-10_11:37:48.368337) 11:37:51.834851 run osmo-hlr_10.42.42.2(pid=2864): stderr: | 20221210113748567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113748567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113748568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113748568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113748568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113748568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113748579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113748589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113748589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113748589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:51.886518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2859): Terminating (SIGTERM) 11:37:51.927926 run iperf3-srv_10.42.42.10(pid=2860): Terminating (SIGTERM) 11:37:51.969466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2863): Terminating (SIGTERM) 11:37:52.010936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2866): Terminating (SIGTERM) 11:37:52.052391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2869): Terminating (SIGTERM) 11:37:52.094224 --- ParallelTerminationStrategy: PID 2859 died... 11:37:52.114103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2859): Terminated: ok {rc=0} 11:37:52.160064 --- ParallelTerminationStrategy: PID 2860 died... 11:37:52.179440 run iperf3-srv_10.42.42.10(pid=2860): Terminated {rc=256} 11:37:52.225188 --- ParallelTerminationStrategy: PID 2863 died... 11:37:52.244454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2863): Terminated: ok {rc=0} 11:37:52.290196 --- ParallelTerminationStrategy: PID 2866 died... 11:37:52.309881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2866): Terminated: ok {rc=0} 11:37:52.355808 --- ParallelTerminationStrategy: PID 2869 died... 11:37:52.375103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2869): Terminated: ok {rc=0} 11:37:52.463048 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 11:37:53.613989 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:53.625516 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:37:53.674419 tst iperf3m4.py: using LAC 28128 11:37:53.800009 tst iperf3m4.py: using RAC 78 11:37:53.926829 tst iperf3m4.py: using CellId 28128 11:37:54.051973 tst iperf3m4.py: using BVCI 28129 11:37:54.167962 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.178946 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.189817 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.200526 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.211198 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.222008 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.232733 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.243503 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:37:54.254431 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:37:54.372938 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:37:54.490641 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:37:54.606210 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:37:54.720913 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:37:54.924502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:37:55.226588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2871): Launched 11:37:55.488637 run iperf3-srv_10.42.42.10(pid=2872): Launched 11:37:55.601908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:37:55.802781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:37:56.103554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2873): Launched 11:37:56.364739 run iperf3-srv_10.42.42.10(pid=2874): Launched 11:37:56.477705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:37:56.678549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:37:56.978693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2875): Launched 11:37:57.239581 run iperf3-srv_10.42.42.10(pid=2876): Launched 11:37:57.351655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:37:57.552045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:37:57.851756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2877): Launched 11:37:58.113316 run iperf3-srv_10.42.42.10(pid=2878): Launched 11:37:58.226162 tst iperf3m4.py:8: start network... 11:37:58.427024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:58.890075 run create_hlr_db(pid=2879): Launched 11:37:59.005593 bus /gobi_6: Setting Powered False 11:38:00.065642 run create_hlr_db(pid=2879): Terminated: ok {rc=0} 11:38:00.483803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2881): Launched 11:38:00.783764 run osmo-hlr_10.42.42.2(pid=2882): Launched 11:38:00.943083 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:01.579811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2884): Launched 11:38:02.045076 run osmo-stp_10.42.42.5(pid=2885): Launched 11:38:02.315704 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:38:02.959969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2887): Launched 11:38:03.083717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:38:03.356622 run patchelf(pid=2888): Launched 11:38:03.535744 run osmo-stp_10.42.42.5(pid=2885): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2885)] 11:38:03.672064 run osmo-stp_10.42.42.5(pid=2885): stdout: | (launched: 2022-12-10_11:38:01.953129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:03.810389 run osmo-stp_10.42.42.5(pid=2885): stderr: | 20221210113802353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113802354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113802354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113802356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113802359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113802359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113802359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:03.948412 run osmo-stp_10.42.42.5(pid=2885): stdout: | (launched: 2022-12-10_11:38:01.953129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:04.080708 run osmo-stp_10.42.42.5(pid=2885): stderr: | 20221210113802353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113802354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113802354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113802356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113802359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113802359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113802359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:04.237213 run patchelf(pid=2888): Terminating (SIGINT) 11:38:04.418295 run patchelf(pid=2888): Terminated: ok {rc=0} 11:38:04.548161 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2885): Process ended prematurely: osmo-stp_10.42.42.5(pid=2885) [trial-2374↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2885)] [trial-2374↪gprs:trx-b200↪iperf3m4.py:8] 11:38:04.558230 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:38:04.586871 run osmo-hlr_10.42.42.2(pid=2882): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2882)] 11:38:04.636859 run osmo-hlr_10.42.42.2(pid=2882): stdout: | (launched: 2022-12-10_11:38:00.729335) 11:38:04.688518 run osmo-hlr_10.42.42.2(pid=2882): stderr: | 20221210113800973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113800973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113800973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113800973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113800973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113800974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113800996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113801021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113801021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113801021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:04.740450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2871): Terminating (SIGTERM) 11:38:04.782114 run iperf3-srv_10.42.42.10(pid=2872): Terminating (SIGTERM) 11:38:04.823698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2873): Terminating (SIGTERM) 11:38:04.865461 run iperf3-srv_10.42.42.10(pid=2874): Terminating (SIGTERM) 11:38:04.907012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2875): Terminating (SIGTERM) 11:38:04.948844 run iperf3-srv_10.42.42.10(pid=2876): Terminating (SIGTERM) 11:38:04.990943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2877): Terminating (SIGTERM) 11:38:05.032599 run iperf3-srv_10.42.42.10(pid=2878): Terminating (SIGTERM) 11:38:05.074377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2881): Terminating (SIGTERM) 11:38:05.116054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2884): Terminating (SIGTERM) 11:38:05.157781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2887): Terminating (SIGTERM) 11:38:05.199670 --- ParallelTerminationStrategy: PID 2871 died... 11:38:05.219622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2871): Terminated: ok {rc=0} 11:38:05.266016 --- ParallelTerminationStrategy: PID 2872 died... 11:38:05.285535 run iperf3-srv_10.42.42.10(pid=2872): Terminated {rc=256} 11:38:05.332082 --- ParallelTerminationStrategy: PID 2873 died... 11:38:05.351751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2873): Terminated: ok {rc=0} 11:38:05.397875 --- ParallelTerminationStrategy: PID 2874 died... 11:38:05.417385 run iperf3-srv_10.42.42.10(pid=2874): Terminated {rc=256} 11:38:05.463399 --- ParallelTerminationStrategy: PID 2875 died... 11:38:05.482930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2875): Terminated: ok {rc=0} 11:38:05.529226 --- ParallelTerminationStrategy: PID 2876 died... 11:38:05.548575 run iperf3-srv_10.42.42.10(pid=2876): Terminated {rc=256} 11:38:05.595079 --- ParallelTerminationStrategy: PID 2877 died... 11:38:05.614560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2877): Terminated: ok {rc=0} 11:38:05.660832 --- ParallelTerminationStrategy: PID 2878 died... 11:38:05.680713 run iperf3-srv_10.42.42.10(pid=2878): Terminated {rc=256} 11:38:05.728333 --- ParallelTerminationStrategy: PID 2881 died... 11:38:05.748628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2881): Terminated: ok {rc=0} 11:38:05.825166 --- ParallelTerminationStrategy: PID 2884 died... 11:38:05.845022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2884): Terminated: ok {rc=0} 11:38:05.890998 --- ParallelTerminationStrategy: PID 2887 died... 11:38:05.909911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2887): Terminated: ok {rc=0} 11:38:05.999439 bus /gobi_4: Setting Powered False 11:38:07.098847 bus /gobi_4: Setting Powered False 11:38:08.216205 bus /gobi_1: Setting Powered False 11:38:09.315868 bus /gobi_1: Setting Powered False 11:38:10.431822 bus /gobi_0: Setting Powered False 11:38:11.529861 bus /gobi_0: Setting Powered False 11:38:12.646519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200 ping.py ---------------------------------------------- 11:38:13.749135 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:13.760054 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:38:13.809319 tst ping.py: using LAC 28129 11:38:13.934831 tst ping.py: using RAC 79 11:38:14.058625 tst ping.py: using CellId 28129 11:38:14.184682 tst ping.py: using BVCI 28130 11:38:14.299505 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:14.310902 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:14.321873 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:14.332683 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:14.343511 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:14.354605 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:14.365619 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:14.376446 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:38:14.488560 tst ping.py:19: start network... 11:38:14.686939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:15.144523 run create_hlr_db(pid=2891): Launched 11:38:15.258303 bus /gobi_6: Setting Powered False 11:38:16.321177 run create_hlr_db(pid=2891): Terminated: ok {rc=0} 11:38:16.842873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2921): Launched 11:38:17.218977 run osmo-hlr_10.42.42.2(pid=2930): Launched 11:38:17.488600 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:18.309484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2993): Launched 11:38:18.741565 run osmo-stp_10.42.42.5(pid=3065): Launched 11:38:19.027992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:38:19.785899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3168): Launched 11:38:19.915608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:38:20.193422 run patchelf(pid=3170): Launched 11:38:20.386447 run osmo-stp_10.42.42.5(pid=3065): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3065)] 11:38:20.525886 run osmo-stp_10.42.42.5(pid=3065): stdout: | (launched: 2022-12-10_11:38:18.667353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:20.666653 run osmo-stp_10.42.42.5(pid=3065): stderr: | 20221210113818976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113818976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113818985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113818985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113818986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113818986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113818986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:20.805172 run osmo-stp_10.42.42.5(pid=3065): stdout: | (launched: 2022-12-10_11:38:18.667353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:20.937976 run osmo-stp_10.42.42.5(pid=3065): stderr: | 20221210113818976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113818976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113818985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113818985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113818986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113818986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113818986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:21.096825 run patchelf(pid=3170): Terminating (SIGINT) 11:38:21.277698 run patchelf(pid=3170): Terminated: ok {rc=0} 11:38:21.410465 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3065): Process ended prematurely: osmo-stp_10.42.42.5(pid=3065) [trial-2374↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3065)] [trial-2374↪gprs:trx-b200↪ping.py:22] 11:38:21.421121 tst ping.py:22: Test FAILED (7.7 sec) 11:38:21.450456 run osmo-hlr_10.42.42.2(pid=2930): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2930)] 11:38:21.501634 run osmo-hlr_10.42.42.2(pid=2930): stdout: | (launched: 2022-12-10_11:38:17.155861) 11:38:21.554320 run osmo-hlr_10.42.42.2(pid=2930): stderr: | 20221210113817439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113817439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113817439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113817439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113817439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113817439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113817455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113817467 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113817468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113817468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:21.607682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2921): Terminating (SIGTERM) 11:38:21.651228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2993): Terminating (SIGTERM) 11:38:21.695486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3168): Terminating (SIGTERM) 11:38:21.738785 --- ParallelTerminationStrategy: PID 2921 died... 11:38:21.759118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2921): Terminated: ok {rc=0} 11:38:21.807183 --- ParallelTerminationStrategy: PID 2993 died... 11:38:21.828492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2993): Terminated: ok {rc=0} 11:38:21.875257 --- ParallelTerminationStrategy: PID 3168 died... 11:38:21.895529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3168): Terminated: ok {rc=0} 11:38:21.985190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 11:38:23.076057 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.088405 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:38:23.139196 tst ping_idle_ping.py: using LAC 28130 11:38:23.271381 tst ping_idle_ping.py: using RAC 80 11:38:23.396893 tst ping_idle_ping.py: using CellId 28130 11:38:23.521238 tst ping_idle_ping.py: using BVCI 28131 11:38:23.639249 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.650941 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.662289 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.673990 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.685181 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.696410 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.707961 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:38:23.719236 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:38:23.838444 tst ping_idle_ping.py:24: start network... 11:38:24.055552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:24.565970 run create_hlr_db(pid=3173): Launched 11:38:24.731503 bus /gobi_6: Setting Powered False 11:38:25.795851 run create_hlr_db(pid=3173): Terminated: ok {rc=0} 11:38:26.257137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3175): Launched 11:38:26.596759 run osmo-hlr_10.42.42.2(pid=3176): Launched 11:38:26.845738 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:27.513613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3178): Launched 11:38:27.855078 run osmo-stp_10.42.42.5(pid=3179): Launched 11:38:28.105393 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:38:28.758480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3181): Launched 11:38:28.894320 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:38:29.178370 run patchelf(pid=3182): Launched 11:38:29.372842 run osmo-stp_10.42.42.5(pid=3179): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3179)] 11:38:29.512614 run osmo-stp_10.42.42.5(pid=3179): stdout: | (launched: 2022-12-10_11:38:27.790775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:29.653921 run osmo-stp_10.42.42.5(pid=3179): stderr: | 20221210113828087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113828087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113828087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113828088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113828088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113828088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113828088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:29.793936 run osmo-stp_10.42.42.5(pid=3179): stdout: | (launched: 2022-12-10_11:38:27.790775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:29.929126 run osmo-stp_10.42.42.5(pid=3179): stderr: | 20221210113828087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113828087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113828087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113828088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113828088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113828088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113828088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:30.089632 run patchelf(pid=3182): Terminating (SIGINT) 11:38:30.274060 run patchelf(pid=3182): Terminated: ok {rc=0} 11:38:30.406686 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3179): Process ended prematurely: osmo-stp_10.42.42.5(pid=3179) [trial-2374↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3179)] [trial-2374↪gprs:trx-b200↪ping_idle_ping.py:27] 11:38:30.418298 tst ping_idle_ping.py:27: Test FAILED (7.3 sec) 11:38:30.448202 run osmo-hlr_10.42.42.2(pid=3176): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3176)] 11:38:30.500167 run osmo-hlr_10.42.42.2(pid=3176): stdout: | (launched: 2022-12-10_11:38:26.533491) 11:38:30.554208 run osmo-hlr_10.42.42.2(pid=3176): stderr: | 20221210113826843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113826844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113826844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113826844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113826844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113826844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113826862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113826878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113826879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113826879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:30.610173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3175): Terminating (SIGTERM) 11:38:30.654181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3178): Terminating (SIGTERM) 11:38:30.700226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3181): Terminating (SIGTERM) 11:38:30.746460 --- ParallelTerminationStrategy: PID 3175 died... 11:38:30.767475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3175): Terminated: ok {rc=0} 11:38:30.817613 --- ParallelTerminationStrategy: PID 3178 died... 11:38:30.838503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3178): Terminated: ok {rc=0} 11:38:30.890732 --- ParallelTerminationStrategy: PID 3181 died... 11:38:30.911983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3181): Terminated: ok {rc=0} 11:38:31.011858 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 11:38:32.387335 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:32.393443 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:38:32.448540 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:38:32.511094 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:38:32.610678 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:38:32.656462 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:38:32.699291 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:38:33.278876 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:38:33.334253 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.346525 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:38:33.397280 tst cs_paging_gprs_active.py: using LAC 28131 11:38:33.527051 tst cs_paging_gprs_active.py: using RAC 81 11:38:33.656670 tst cs_paging_gprs_active.py: using CellId 28131 11:38:33.785225 tst cs_paging_gprs_active.py: using BVCI 28132 11:38:33.906895 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.919487 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.931591 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.943585 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.955427 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.967487 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.980406 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:33.992259 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:34.004509 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:38:34.128804 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:38:34.254022 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:38:34.480894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:34.820338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3186): Launched 11:38:35.125084 run iperf3-srv_10.42.42.10(pid=3187): Launched 11:38:35.263642 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:38:35.491940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:35.832589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3188): Launched 11:38:36.138952 run iperf3-srv_10.42.42.10(pid=3189): Launched 11:38:36.277556 tst cs_paging_gprs_active.py:38: start network... 11:38:36.504146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:37.027530 run create_hlr_db(pid=3190): Launched 11:38:37.197692 bus /gobi_6: Setting Powered False 11:38:38.264180 run create_hlr_db(pid=3190): Terminated: ok {rc=0} 11:38:38.733667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3192): Launched 11:38:39.081101 run osmo-hlr_10.42.42.2(pid=3193): Launched 11:38:39.337066 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:40.006123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3195): Launched 11:38:40.314706 run osmo-stp_10.42.42.5(pid=3196): Launched 11:38:40.429421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:38:40.947269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3198): Launched 11:38:41.062701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:38:41.315607 run patchelf(pid=3199): Launched 11:38:41.483279 run osmo-stp_10.42.42.5(pid=3196): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3196)] 11:38:41.611015 run osmo-stp_10.42.42.5(pid=3196): stdout: | (launched: 2022-12-10_11:38:40.260148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:41.740129 run osmo-stp_10.42.42.5(pid=3196): stderr: | 20221210113840430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113840430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113840431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113840431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113840431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113840432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113840432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:41.869992 run osmo-stp_10.42.42.5(pid=3196): stdout: | (launched: 2022-12-10_11:38:40.260148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:41.993243 run osmo-stp_10.42.42.5(pid=3196): stderr: | 20221210113840430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113840430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113840431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113840431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113840431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113840432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113840432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:42.139679 run patchelf(pid=3199): Terminating (SIGINT) 11:38:42.308410 run patchelf(pid=3199): Terminated: ok {rc=0} 11:38:42.430868 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3196): Process ended prematurely: osmo-stp_10.42.42.5(pid=3196) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3196)] [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:38:42.440193 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 11:38:42.467602 run osmo-hlr_10.42.42.2(pid=3193): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3193)] 11:38:42.515457 run osmo-hlr_10.42.42.2(pid=3193): stdout: | (launched: 2022-12-10_11:38:39.017287) 11:38:42.564621 run osmo-hlr_10.42.42.2(pid=3193): stderr: | 20221210113839336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113839336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113839336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113839336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113839336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113839336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113839357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113839370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113839371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113839371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:42.614282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3186): Terminating (SIGTERM) 11:38:42.653694 run iperf3-srv_10.42.42.10(pid=3187): Terminating (SIGTERM) 11:38:42.693007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3188): Terminating (SIGTERM) 11:38:42.732614 run iperf3-srv_10.42.42.10(pid=3189): Terminating (SIGTERM) 11:38:42.772128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3192): Terminating (SIGTERM) 11:38:42.811708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3195): Terminating (SIGTERM) 11:38:42.851441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3198): Terminating (SIGTERM) 11:38:42.891164 --- ParallelTerminationStrategy: PID 3186 died... 11:38:42.909924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3186): Terminated: ok {rc=0} 11:38:42.953646 --- ParallelTerminationStrategy: PID 3187 died... 11:38:42.971801 run iperf3-srv_10.42.42.10(pid=3187): Terminated {rc=256} 11:38:43.015481 --- ParallelTerminationStrategy: PID 3188 died... 11:38:43.033752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3188): Terminated: ok {rc=0} 11:38:43.077283 --- ParallelTerminationStrategy: PID 3189 died... 11:38:43.095507 run iperf3-srv_10.42.42.10(pid=3189): Terminated {rc=256} 11:38:43.139220 --- ParallelTerminationStrategy: PID 3192 died... 11:38:43.157421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3192): Terminated: ok {rc=0} 11:38:43.201240 --- ParallelTerminationStrategy: PID 3195 died... 11:38:43.219541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3195): Terminated: ok {rc=0} 11:38:43.263680 --- ParallelTerminationStrategy: PID 3198 died... 11:38:43.282040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3198): Terminated: ok {rc=0} 11:38:43.367528 bus /gobi_0: Setting Powered False 11:38:44.465457 bus /gobi_0: Setting Powered False 11:38:45.580393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:38:46.726958 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:46.739258 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:38:46.798539 tst iperf3.py: using LAC 28132 11:38:46.921160 tst iperf3.py: using RAC 82 11:38:47.043154 tst iperf3.py: using CellId 28132 11:38:47.169313 tst iperf3.py: using BVCI 28133 11:38:47.280377 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.291393 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.302112 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.313594 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.324831 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.336146 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.347791 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.359178 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:47.370710 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:38:47.491465 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:38:47.710591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:48.032700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3200): Launched 11:38:48.311869 run iperf3-srv_10.42.42.10(pid=3201): Launched 11:38:48.433659 tst iperf3.py:8: start network... 11:38:48.651250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:49.147714 run create_hlr_db(pid=3202): Launched 11:38:49.278014 bus /gobi_6: Setting Powered False 11:38:50.341928 run create_hlr_db(pid=3202): Terminated: ok {rc=0} 11:38:50.771801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3204): Launched 11:38:51.071369 run osmo-hlr_10.42.42.2(pid=3205): Launched 11:38:51.186146 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:51.717350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3207): Launched 11:38:52.019817 run osmo-stp_10.42.42.5(pid=3208): Launched 11:38:52.145269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:38:52.703722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3210): Launched 11:38:52.826437 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:38:53.097172 run patchelf(pid=3211): Launched 11:38:53.275343 run osmo-stp_10.42.42.5(pid=3208): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3208)] 11:38:53.411579 run osmo-stp_10.42.42.5(pid=3208): stdout: | (launched: 2022-12-10_11:38:51.964134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:53.549184 run osmo-stp_10.42.42.5(pid=3208): stderr: | 20221210113852151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113852152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113852152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113852152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113852153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113852153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113852153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:53.687171 run osmo-stp_10.42.42.5(pid=3208): stdout: | (launched: 2022-12-10_11:38:51.964134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:53.818628 run osmo-stp_10.42.42.5(pid=3208): stderr: | 20221210113852151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113852152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113852152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113852152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113852153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113852153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113852153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:53.974500 run patchelf(pid=3211): Terminating (SIGINT) 11:38:54.154433 run patchelf(pid=3211): Terminated: ok {rc=0} 11:38:54.283731 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3208): Process ended prematurely: osmo-stp_10.42.42.5(pid=3208) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3208)] [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 11:38:54.293682 tst iperf3.py:8: Test FAILED (7.6 sec) 11:38:54.322060 run osmo-hlr_10.42.42.2(pid=3205): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3205)] 11:38:54.372263 run osmo-hlr_10.42.42.2(pid=3205): stdout: | (launched: 2022-12-10_11:38:51.017126) 11:38:54.423252 run osmo-hlr_10.42.42.2(pid=3205): stderr: | 20221210113851191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113851191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113851191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113851191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113851191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113851191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113851203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113851212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113851213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113851213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:54.474812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3200): Terminating (SIGTERM) 11:38:54.515916 run iperf3-srv_10.42.42.10(pid=3201): Terminating (SIGTERM) 11:38:54.557032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3204): Terminating (SIGTERM) 11:38:54.598204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3207): Terminating (SIGTERM) 11:38:54.639358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3210): Terminating (SIGTERM) 11:38:54.680810 --- ParallelTerminationStrategy: PID 3200 died... 11:38:54.700514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3200): Terminated: ok {rc=0} 11:38:54.746023 --- ParallelTerminationStrategy: PID 3201 died... 11:38:54.765177 run iperf3-srv_10.42.42.10(pid=3201): Terminated {rc=256} 11:38:54.810497 --- ParallelTerminationStrategy: PID 3204 died... 11:38:54.829783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3204): Terminated: ok {rc=0} 11:38:54.875246 --- ParallelTerminationStrategy: PID 3207 died... 11:38:54.894505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3207): Terminated: ok {rc=0} 11:38:54.939783 --- ParallelTerminationStrategy: PID 3210 died... 11:38:54.959130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3210): Terminated: ok {rc=0} 11:38:55.047834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:38:56.195642 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.210702 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:38:56.260163 tst iperf3m4.py: using LAC 28133 11:38:56.387927 tst iperf3m4.py: using RAC 83 11:38:56.515000 tst iperf3m4.py: using CellId 28133 11:38:56.641387 tst iperf3m4.py: using BVCI 28134 11:38:56.757834 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.769048 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.780068 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.791009 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.801882 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.812725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.823897 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.834852 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:38:56.845873 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:38:56.962505 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:38:57.081892 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:38:57.197398 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:38:57.311969 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:38:57.515426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:57.819369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3212): Launched 11:38:58.080434 run iperf3-srv_10.42.42.10(pid=3213): Launched 11:38:58.193705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:38:58.394853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:58.695561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3214): Launched 11:38:58.957701 run iperf3-srv_10.42.42.10(pid=3215): Launched 11:38:59.071184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:38:59.272415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:59.573450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3216): Launched 11:38:59.835500 run iperf3-srv_10.42.42.10(pid=3217): Launched 11:38:59.948190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:39:00.148941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:00.450667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3218): Launched 11:39:00.712232 run iperf3-srv_10.42.42.10(pid=3219): Launched 11:39:00.825183 tst iperf3m4.py:8: start network... 11:39:01.050800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:01.527895 run create_hlr_db(pid=3220): Launched 11:39:01.691612 bus /gobi_6: Setting Powered False 11:39:02.754911 run create_hlr_db(pid=3220): Terminated: ok {rc=0} 11:39:03.185183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3222): Launched 11:39:03.485891 run osmo-hlr_10.42.42.2(pid=3223): Launched 11:39:03.600608 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:04.117642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3225): Launched 11:39:04.418634 run osmo-stp_10.42.42.5(pid=3226): Launched 11:39:04.532941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:05.051330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3228): Launched 11:39:05.166598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:05.421212 run patchelf(pid=3229): Launched 11:39:05.589383 run osmo-stp_10.42.42.5(pid=3226): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3226)] 11:39:05.717287 run osmo-stp_10.42.42.5(pid=3226): stdout: | (launched: 2022-12-10_11:39:04.363189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:05.847344 run osmo-stp_10.42.42.5(pid=3226): stderr: | 20221210113904531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113904531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113904532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113904532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113904533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113904533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113904533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:05.976310 run osmo-stp_10.42.42.5(pid=3226): stdout: | (launched: 2022-12-10_11:39:04.363189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:06.099587 run osmo-stp_10.42.42.5(pid=3226): stderr: | 20221210113904531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113904531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113904532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113904532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113904533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113904533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113904533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:06.246063 run patchelf(pid=3229): Terminating (SIGINT) 11:39:06.415175 run patchelf(pid=3229): Terminated: ok {rc=0} 11:39:06.536569 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3226): Process ended prematurely: osmo-stp_10.42.42.5(pid=3226) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3226)] [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 11:39:06.545996 tst iperf3m4.py:8: Test FAILED (10.4 sec) 11:39:06.573775 run osmo-hlr_10.42.42.2(pid=3223): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3223)] 11:39:06.621524 run osmo-hlr_10.42.42.2(pid=3223): stdout: | (launched: 2022-12-10_11:39:03.430871) 11:39:06.670881 run osmo-hlr_10.42.42.2(pid=3223): stderr: | 20221210113903605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113903605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113903606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113903606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113903606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113903606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113903622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113903632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113903632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113903632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:06.720388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3212): Terminating (SIGTERM) 11:39:06.760159 run iperf3-srv_10.42.42.10(pid=3213): Terminating (SIGTERM) 11:39:06.799629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3214): Terminating (SIGTERM) 11:39:06.839391 run iperf3-srv_10.42.42.10(pid=3215): Terminating (SIGTERM) 11:39:06.879090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3216): Terminating (SIGTERM) 11:39:06.918789 run iperf3-srv_10.42.42.10(pid=3217): Terminating (SIGTERM) 11:39:06.958421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3218): Terminating (SIGTERM) 11:39:06.998188 run iperf3-srv_10.42.42.10(pid=3219): Terminating (SIGTERM) 11:39:07.037885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3222): Terminating (SIGTERM) 11:39:07.077701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3225): Terminating (SIGTERM) 11:39:07.117487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3228): Terminating (SIGTERM) 11:39:07.157474 --- ParallelTerminationStrategy: PID 3212 died... 11:39:07.176268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3212): Terminated: ok {rc=0} 11:39:07.220533 --- ParallelTerminationStrategy: PID 3213 died... 11:39:07.239129 run iperf3-srv_10.42.42.10(pid=3213): Terminated {rc=256} 11:39:07.283125 --- ParallelTerminationStrategy: PID 3214 died... 11:39:07.301650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3214): Terminated: ok {rc=0} 11:39:07.345554 --- ParallelTerminationStrategy: PID 3215 died... 11:39:07.364036 run iperf3-srv_10.42.42.10(pid=3215): Terminated {rc=256} 11:39:07.407928 --- ParallelTerminationStrategy: PID 3216 died... 11:39:07.426466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3216): Terminated: ok {rc=0} 11:39:07.470651 --- ParallelTerminationStrategy: PID 3217 died... 11:39:07.488921 run iperf3-srv_10.42.42.10(pid=3217): Terminated {rc=256} 11:39:07.532803 --- ParallelTerminationStrategy: PID 3218 died... 11:39:07.551640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3218): Terminated: ok {rc=0} 11:39:07.595689 --- ParallelTerminationStrategy: PID 3219 died... 11:39:07.614258 run iperf3-srv_10.42.42.10(pid=3219): Terminated {rc=256} 11:39:07.658196 --- ParallelTerminationStrategy: PID 3222 died... 11:39:07.676763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3222): Terminated: ok {rc=0} 11:39:07.720713 --- ParallelTerminationStrategy: PID 3225 died... 11:39:07.739395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3225): Terminated: ok {rc=0} 11:39:07.783444 --- ParallelTerminationStrategy: PID 3228 died... 11:39:07.802048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3228): Terminated: ok {rc=0} 11:39:07.888021 bus /gobi_4: Setting Powered False 11:39:08.988000 bus /gobi_4: Setting Powered False 11:39:10.103468 bus /gobi_1: Setting Powered False 11:39:11.201651 bus /gobi_1: Setting Powered False 11:39:12.316403 bus /gobi_0: Setting Powered False 11:39:13.413901 bus /gobi_0: Setting Powered False 11:39:14.529439 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 11:39:15.631442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:15.643246 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:39:15.695693 tst ping.py: using LAC 28134 11:39:15.821027 tst ping.py: using RAC 84 11:39:15.966007 tst ping.py: using CellId 28134 11:39:16.107355 tst ping.py: using BVCI 28135 11:39:16.219916 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:16.231810 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:16.246143 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:16.264437 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:16.283629 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:16.301147 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:16.317611 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:16.334388 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:39:16.454816 tst ping.py:19: start network... 11:39:16.698921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:17.200017 run create_hlr_db(pid=3230): Launched 11:39:17.339515 bus /gobi_6: Setting Powered False 11:39:18.402910 run create_hlr_db(pid=3230): Terminated: ok {rc=0} 11:39:18.827156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3232): Launched 11:39:19.123410 run osmo-hlr_10.42.42.2(pid=3233): Launched 11:39:19.237158 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:19.763917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3235): Launched 11:39:20.059725 run osmo-stp_10.42.42.5(pid=3236): Launched 11:39:20.172588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:20.681180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3238): Launched 11:39:20.794316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:21.043158 run patchelf(pid=3239): Launched 11:39:21.207073 run osmo-stp_10.42.42.5(pid=3236): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3236)] 11:39:21.332023 run osmo-stp_10.42.42.5(pid=3236): stdout: | (launched: 2022-12-10_11:39:20.005452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:21.458825 run osmo-stp_10.42.42.5(pid=3236): stderr: | 20221210113920174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113920174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113920174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113920175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113920175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113920175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113920175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:21.585129 run osmo-stp_10.42.42.5(pid=3236): stdout: | (launched: 2022-12-10_11:39:20.005452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:21.705979 run osmo-stp_10.42.42.5(pid=3236): stderr: | 20221210113920174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113920174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113920174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113920175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113920175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113920175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113920175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:21.849864 run patchelf(pid=3239): Terminating (SIGINT) 11:39:22.015194 run patchelf(pid=3239): Terminated: ok {rc=0} 11:39:22.134571 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3236): Process ended prematurely: osmo-stp_10.42.42.5(pid=3236) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3236)] [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 11:39:22.143363 tst ping.py:22: Test FAILED (6.5 sec) 11:39:22.170224 run osmo-hlr_10.42.42.2(pid=3233): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3233)] 11:39:22.218104 run osmo-hlr_10.42.42.2(pid=3233): stdout: | (launched: 2022-12-10_11:39:19.069296) 11:39:22.267543 run osmo-hlr_10.42.42.2(pid=3233): stderr: | 20221210113919243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113919243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113919243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113919243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113919243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113919243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113919254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113919263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113919263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113919263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:22.317309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3232): Terminating (SIGTERM) 11:39:22.357353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3235): Terminating (SIGTERM) 11:39:22.397203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3238): Terminating (SIGTERM) 11:39:22.437268 --- ParallelTerminationStrategy: PID 3232 died... 11:39:22.456299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3232): Terminated: ok {rc=0} 11:39:22.500781 --- ParallelTerminationStrategy: PID 3235 died... 11:39:22.519521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3235): Terminated: ok {rc=0} 11:39:22.563961 --- ParallelTerminationStrategy: PID 3238 died... 11:39:22.582602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3238): Terminated: ok {rc=0} 11:39:22.668476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:39:23.756523 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:23.768071 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:39:23.821104 tst ping_idle_ping.py: using LAC 28135 11:39:23.940728 tst ping_idle_ping.py: using RAC 85 11:39:24.066695 tst ping_idle_ping.py: using CellId 28135 11:39:24.192759 tst ping_idle_ping.py: using BVCI 28136 11:39:24.307639 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:24.319190 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:24.330544 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:24.342353 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:24.353922 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:24.364938 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:24.376346 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:24.387781 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:39:24.507222 tst ping_idle_ping.py:24: start network... 11:39:24.721727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:25.215480 run create_hlr_db(pid=3240): Launched 11:39:25.345707 bus /gobi_6: Setting Powered False 11:39:26.409895 run create_hlr_db(pid=3240): Terminated: ok {rc=0} 11:39:26.835560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3242): Launched 11:39:27.132868 run osmo-hlr_10.42.42.2(pid=3243): Launched 11:39:27.247273 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:27.759254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3245): Launched 11:39:28.057591 run osmo-stp_10.42.42.5(pid=3246): Launched 11:39:28.172268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:28.685780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3248): Launched 11:39:28.799064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:29.049426 run patchelf(pid=3249): Launched 11:39:29.214649 run osmo-stp_10.42.42.5(pid=3246): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3246)] 11:39:29.340404 run osmo-stp_10.42.42.5(pid=3246): stdout: | (launched: 2022-12-10_11:39:28.003046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:29.467486 run osmo-stp_10.42.42.5(pid=3246): stderr: | 20221210113928172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113928172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113928172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113928173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113928173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113928173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113928173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:29.594498 run osmo-stp_10.42.42.5(pid=3246): stdout: | (launched: 2022-12-10_11:39:28.003046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:29.716015 run osmo-stp_10.42.42.5(pid=3246): stderr: | 20221210113928172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113928172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113928172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113928173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113928173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113928173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113928173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:29.859739 run patchelf(pid=3249): Terminating (SIGINT) 11:39:30.026876 run patchelf(pid=3249): Terminated: ok {rc=0} 11:39:30.147020 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3246): Process ended prematurely: osmo-stp_10.42.42.5(pid=3246) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3246)] [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 11:39:30.155801 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:39:30.182673 run osmo-hlr_10.42.42.2(pid=3243): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3243)] 11:39:30.230578 run osmo-hlr_10.42.42.2(pid=3243): stdout: | (launched: 2022-12-10_11:39:27.078740) 11:39:30.279770 run osmo-hlr_10.42.42.2(pid=3243): stderr: | 20221210113927253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113927253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113927253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113927254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113927254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113927254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113927266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113927276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113927277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113927277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:30.329693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3242): Terminating (SIGTERM) 11:39:30.369342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3245): Terminating (SIGTERM) 11:39:30.409326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3248): Terminating (SIGTERM) 11:39:30.450137 --- ParallelTerminationStrategy: PID 3242 died... 11:39:30.469255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3242): Terminated: ok {rc=0} 11:39:30.513990 --- ParallelTerminationStrategy: PID 3245 died... 11:39:30.532727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3245): Terminated: ok {rc=0} 11:39:30.577244 --- ParallelTerminationStrategy: PID 3248 died... 11:39:30.595831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3248): Terminated: ok {rc=0} 11:39:30.683143 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:39:31.994702 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:39:32.002784 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:39:32.040079 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:39:32.079957 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:39:32.168771 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:39:32.208063 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:39:32.248702 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:39:32.830732 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:39:32.879570 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:32.890489 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:39:32.962328 tst cs_paging_gprs_active.py: using LAC 28136 11:39:33.080669 tst cs_paging_gprs_active.py: using RAC 86 11:39:33.197096 tst cs_paging_gprs_active.py: using CellId 28136 11:39:33.314150 tst cs_paging_gprs_active.py: using BVCI 28137 11:39:33.422835 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.433649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.444196 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.454978 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.466009 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.476853 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.487879 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.498811 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:33.509821 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:39:33.626246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:39:33.740653 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:39:33.943726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:34.245742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3253): Launched 11:39:34.508281 run iperf3-srv_10.42.42.10(pid=3254): Launched 11:39:34.621245 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:39:34.823074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:35.124664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3255): Launched 11:39:35.385983 run iperf3-srv_10.42.42.10(pid=3256): Launched 11:39:35.498716 tst cs_paging_gprs_active.py:38: start network... 11:39:35.700409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:36.166213 run create_hlr_db(pid=3257): Launched 11:39:36.280213 bus /gobi_6: Setting Powered False 11:39:37.339692 run create_hlr_db(pid=3257): Terminated: ok {rc=0} 11:39:37.759199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3259): Launched 11:39:38.060591 run osmo-hlr_10.42.42.2(pid=3260): Launched 11:39:38.176480 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:38.696652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3262): Launched 11:39:38.997263 run osmo-stp_10.42.42.5(pid=3263): Launched 11:39:39.112267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:39.630230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3265): Launched 11:39:39.745531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:39.999729 run patchelf(pid=3266): Launched 11:39:40.167128 run osmo-stp_10.42.42.5(pid=3263): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3263)] 11:39:40.294866 run osmo-stp_10.42.42.5(pid=3263): stdout: | (launched: 2022-12-10_11:39:38.942581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:40.424116 run osmo-stp_10.42.42.5(pid=3263): stderr: | 20221210113939114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113939114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113939114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113939114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113939115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113939115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113939115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:40.553384 run osmo-stp_10.42.42.5(pid=3263): stdout: | (launched: 2022-12-10_11:39:38.942581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:40.676375 run osmo-stp_10.42.42.5(pid=3263): stderr: | 20221210113939114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113939114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113939114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113939114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113939115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113939115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113939115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:40.822578 run patchelf(pid=3266): Terminating (SIGINT) 11:39:40.991455 run patchelf(pid=3266): Terminated: ok {rc=0} 11:39:41.113058 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3263): Process ended prematurely: osmo-stp_10.42.42.5(pid=3263) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3263)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:39:41.122405 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 11:39:41.149761 run osmo-hlr_10.42.42.2(pid=3260): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3260)] 11:39:41.197343 run osmo-hlr_10.42.42.2(pid=3260): stdout: | (launched: 2022-12-10_11:39:38.006009) 11:39:41.246582 run osmo-hlr_10.42.42.2(pid=3260): stderr: | 20221210113938181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113938181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113938181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113938181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113938181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113938181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113938193 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113938202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113938202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113938202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:41.296400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3253): Terminating (SIGTERM) 11:39:41.336291 run iperf3-srv_10.42.42.10(pid=3254): Terminating (SIGTERM) 11:39:41.375901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3255): Terminating (SIGTERM) 11:39:41.415620 run iperf3-srv_10.42.42.10(pid=3256): Terminating (SIGTERM) 11:39:41.455222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3259): Terminating (SIGTERM) 11:39:41.494858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3262): Terminating (SIGTERM) 11:39:41.534419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3265): Terminating (SIGTERM) 11:39:41.574318 --- ParallelTerminationStrategy: PID 3253 died... 11:39:41.592931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3253): Terminated: ok {rc=0} 11:39:41.637439 --- ParallelTerminationStrategy: PID 3254 died... 11:39:41.655687 run iperf3-srv_10.42.42.10(pid=3254): Terminated {rc=256} 11:39:41.699401 --- ParallelTerminationStrategy: PID 3255 died... 11:39:41.717756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3255): Terminated: ok {rc=0} 11:39:41.761449 --- ParallelTerminationStrategy: PID 3256 died... 11:39:41.779689 run iperf3-srv_10.42.42.10(pid=3256): Terminated {rc=256} 11:39:41.823256 --- ParallelTerminationStrategy: PID 3259 died... 11:39:41.841433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3259): Terminated: ok {rc=0} 11:39:41.885116 --- ParallelTerminationStrategy: PID 3262 died... 11:39:41.903494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3262): Terminated: ok {rc=0} 11:39:41.947252 --- ParallelTerminationStrategy: PID 3265 died... 11:39:41.965949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3265): Terminated: ok {rc=0} 11:39:42.050623 bus /gobi_0: Setting Powered False 11:39:43.148887 bus /gobi_0: Setting Powered False 11:39:44.262749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:39:45.408278 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:45.419802 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:39:45.492384 tst iperf3.py: using LAC 28137 11:39:45.613652 tst iperf3.py: using RAC 87 11:39:45.731573 tst iperf3.py: using CellId 28137 11:39:45.871999 tst iperf3.py: using BVCI 28138 11:39:45.992356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.004659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.016585 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.031440 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.043052 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.055878 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.070082 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.082499 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:46.094384 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:39:46.212641 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:39:46.461792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:46.795342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3267): Launched 11:39:47.094731 run iperf3-srv_10.42.42.10(pid=3268): Launched 11:39:47.225554 tst iperf3.py:8: start network... 11:39:47.442865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:47.940420 run create_hlr_db(pid=3269): Launched 11:39:48.071424 bus /gobi_6: Setting Powered False 11:39:49.134638 run create_hlr_db(pid=3269): Terminated: ok {rc=0} 11:39:49.584337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3271): Launched 11:39:49.904655 run osmo-hlr_10.42.42.2(pid=3272): Launched 11:39:50.027156 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:50.585973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3274): Launched 11:39:50.907124 run osmo-stp_10.42.42.5(pid=3275): Launched 11:39:51.029740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:51.588863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3277): Launched 11:39:51.712141 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:51.983966 run patchelf(pid=3278): Launched 11:39:52.163319 run osmo-stp_10.42.42.5(pid=3275): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3275)] 11:39:52.299371 run osmo-stp_10.42.42.5(pid=3275): stdout: | (launched: 2022-12-10_11:39:50.848648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:52.438316 run osmo-stp_10.42.42.5(pid=3275): stderr: | 20221210113951041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113951041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113951041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113951042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113951044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113951044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113951044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:52.576201 run osmo-stp_10.42.42.5(pid=3275): stdout: | (launched: 2022-12-10_11:39:50.848648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:52.707988 run osmo-stp_10.42.42.5(pid=3275): stderr: | 20221210113951041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210113951041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210113951041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210113951042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210113951044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210113951044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210113951044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:52.864282 run patchelf(pid=3278): Terminating (SIGINT) 11:39:53.044774 run patchelf(pid=3278): Terminated: ok {rc=0} 11:39:53.175014 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3275): Process ended prematurely: osmo-stp_10.42.42.5(pid=3275) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3275)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 11:39:53.184839 tst iperf3.py:8: Test FAILED (7.8 sec) 11:39:53.213544 run osmo-hlr_10.42.42.2(pid=3272): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3272)] 11:39:53.263746 run osmo-hlr_10.42.42.2(pid=3272): stdout: | (launched: 2022-12-10_11:39:49.846676) 11:39:53.315523 run osmo-hlr_10.42.42.2(pid=3272): stderr: | 20221210113950048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210113950048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210113950048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210113950048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210113950048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210113950048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210113950061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210113950070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210113950070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210113950070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:53.368233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3267): Terminating (SIGTERM) 11:39:53.410356 run iperf3-srv_10.42.42.10(pid=3268): Terminating (SIGTERM) 11:39:53.452203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3271): Terminating (SIGTERM) 11:39:53.494298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3274): Terminating (SIGTERM) 11:39:53.536210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3277): Terminating (SIGTERM) 11:39:53.578528 --- ParallelTerminationStrategy: PID 3267 died... 11:39:53.598592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3267): Terminated: ok {rc=0} 11:39:53.645071 --- ParallelTerminationStrategy: PID 3268 died... 11:39:53.664610 run iperf3-srv_10.42.42.10(pid=3268): Terminated {rc=256} 11:39:53.710703 --- ParallelTerminationStrategy: PID 3271 died... 11:39:53.730265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3271): Terminated: ok {rc=0} 11:39:53.776280 --- ParallelTerminationStrategy: PID 3274 died... 11:39:53.795951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3274): Terminated: ok {rc=0} 11:39:53.842130 --- ParallelTerminationStrategy: PID 3277 died... 11:39:53.861667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3277): Terminated: ok {rc=0} 11:39:53.950023 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:39:55.100845 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.112821 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:39:55.184253 tst iperf3m4.py: using LAC 28138 11:39:55.311942 tst iperf3m4.py: using RAC 88 11:39:55.437586 tst iperf3m4.py: using CellId 28138 11:39:55.562779 tst iperf3m4.py: using BVCI 28139 11:39:55.679191 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.690434 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.701641 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.712807 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.723851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.735150 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.746297 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.757398 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:39:55.768610 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:39:55.885278 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:39:56.004710 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:39:56.119684 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:39:56.234004 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:39:56.436846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:56.739091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3279): Launched 11:39:57.001811 run iperf3-srv_10.42.42.10(pid=3280): Launched 11:39:57.115496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:39:57.316550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:57.618395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3281): Launched 11:39:57.880202 run iperf3-srv_10.42.42.10(pid=3282): Launched 11:39:57.993317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:39:58.194836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:58.495725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3283): Launched 11:39:58.757307 run iperf3-srv_10.42.42.10(pid=3284): Launched 11:39:58.870904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:39:59.071706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:59.373024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3285): Launched 11:39:59.634601 run iperf3-srv_10.42.42.10(pid=3286): Launched 11:39:59.748147 tst iperf3m4.py:8: start network... 11:39:59.949666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:00.415319 run create_hlr_db(pid=3288): Launched 11:40:00.531370 bus /gobi_6: Setting Powered False 11:40:01.600201 run create_hlr_db(pid=3288): Terminated: ok {rc=0} 11:40:02.069947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3293): Launched 11:40:02.399742 run osmo-hlr_10.42.42.2(pid=3294): Launched 11:40:02.523815 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:03.079712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3296): Launched 11:40:03.402366 run osmo-stp_10.42.42.5(pid=3297): Launched 11:40:03.524743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:04.079835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3299): Launched 11:40:04.203328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:04.475853 run patchelf(pid=3300): Launched 11:40:04.655058 run osmo-stp_10.42.42.5(pid=3297): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3297)] 11:40:04.791372 run osmo-stp_10.42.42.5(pid=3297): stdout: | (launched: 2022-12-10_11:40:03.343479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:04.929889 run osmo-stp_10.42.42.5(pid=3297): stderr: | 20221210114003538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114003539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114003539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114003539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114003540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114003540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114003540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:05.067780 run osmo-stp_10.42.42.5(pid=3297): stdout: | (launched: 2022-12-10_11:40:03.343479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:05.200228 run osmo-stp_10.42.42.5(pid=3297): stderr: | 20221210114003538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114003539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114003539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114003539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114003540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114003540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114003540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:05.357607 run patchelf(pid=3300): Terminating (SIGINT) 11:40:05.538632 run patchelf(pid=3300): Terminated: ok {rc=0} 11:40:05.668588 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3297): Process ended prematurely: osmo-stp_10.42.42.5(pid=3297) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3297)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:40:05.678775 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:40:05.707455 run osmo-hlr_10.42.42.2(pid=3294): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3294)] 11:40:05.757543 run osmo-hlr_10.42.42.2(pid=3294): stdout: | (launched: 2022-12-10_11:40:02.340695) 11:40:05.809257 run osmo-hlr_10.42.42.2(pid=3294): stderr: | 20221210114002539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114002539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114002539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114002539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114002539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114002539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114002552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114002560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114002560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114002561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:05.861417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3279): Terminating (SIGTERM) 11:40:05.903362 run iperf3-srv_10.42.42.10(pid=3280): Terminating (SIGTERM) 11:40:05.946499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3281): Terminating (SIGTERM) 11:40:05.988656 run iperf3-srv_10.42.42.10(pid=3282): Terminating (SIGTERM) 11:40:06.030422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3283): Terminating (SIGTERM) 11:40:06.072215 run iperf3-srv_10.42.42.10(pid=3284): Terminating (SIGTERM) 11:40:06.113956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3285): Terminating (SIGTERM) 11:40:06.155764 run iperf3-srv_10.42.42.10(pid=3286): Terminating (SIGTERM) 11:40:06.197682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3293): Terminating (SIGTERM) 11:40:06.239509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3296): Terminating (SIGTERM) 11:40:06.281271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3299): Terminating (SIGTERM) 11:40:06.323249 --- ParallelTerminationStrategy: PID 3279 died... 11:40:06.343390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3279): Terminated: ok {rc=0} 11:40:06.390455 --- ParallelTerminationStrategy: PID 3280 died... 11:40:06.410205 run iperf3-srv_10.42.42.10(pid=3280): Terminated {rc=256} 11:40:06.456276 --- ParallelTerminationStrategy: PID 3281 died... 11:40:06.475931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3281): Terminated: ok {rc=0} 11:40:06.522509 --- ParallelTerminationStrategy: PID 3282 died... 11:40:06.542134 run iperf3-srv_10.42.42.10(pid=3282): Terminated {rc=256} 11:40:06.588310 --- ParallelTerminationStrategy: PID 3283 died... 11:40:06.607992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3283): Terminated: ok {rc=0} 11:40:06.654174 --- ParallelTerminationStrategy: PID 3284 died... 11:40:06.673785 run iperf3-srv_10.42.42.10(pid=3284): Terminated {rc=256} 11:40:06.719835 --- ParallelTerminationStrategy: PID 3285 died... 11:40:06.739560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3285): Terminated: ok {rc=0} 11:40:06.785630 --- ParallelTerminationStrategy: PID 3286 died... 11:40:06.805321 run iperf3-srv_10.42.42.10(pid=3286): Terminated {rc=256} 11:40:06.851253 --- ParallelTerminationStrategy: PID 3293 died... 11:40:06.870949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3293): Terminated: ok {rc=0} 11:40:06.917236 --- ParallelTerminationStrategy: PID 3296 died... 11:40:06.936709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3296): Terminated: ok {rc=0} 11:40:06.983241 --- ParallelTerminationStrategy: PID 3299 died... 11:40:07.002934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3299): Terminated: ok {rc=0} 11:40:07.090550 bus /gobi_4: Setting Powered False 11:40:08.189957 bus /gobi_4: Setting Powered False 11:40:09.306440 bus /gobi_1: Setting Powered False 11:40:10.407617 bus /gobi_1: Setting Powered False 11:40:11.524115 bus /gobi_0: Setting Powered False 11:40:12.622985 bus /gobi_0: Setting Powered False 11:40:13.738710 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:40:14.841619 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:14.853596 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:40:14.926941 tst ping.py: using LAC 28139 11:40:15.048259 tst ping.py: using RAC 89 11:40:15.162862 tst ping.py: using CellId 28139 11:40:15.277380 tst ping.py: using BVCI 28140 11:40:15.384481 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:15.395512 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:15.406249 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:15.417087 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:15.427798 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:15.438564 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:15.449508 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:15.460218 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:40:15.575732 tst ping.py:19: start network... 11:40:15.789307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:16.290355 run create_hlr_db(pid=3301): Launched 11:40:16.452941 bus /gobi_6: Setting Powered False 11:40:17.516416 run create_hlr_db(pid=3301): Terminated: ok {rc=0} 11:40:17.957015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3303): Launched 11:40:18.273319 run osmo-hlr_10.42.42.2(pid=3304): Launched 11:40:18.394953 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:18.944334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3306): Launched 11:40:19.260150 run osmo-stp_10.42.42.5(pid=3307): Launched 11:40:19.381960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:19.926409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3309): Launched 11:40:20.047063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:20.314317 run patchelf(pid=3310): Launched 11:40:20.490518 run osmo-stp_10.42.42.5(pid=3307): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3307)] 11:40:20.624141 run osmo-stp_10.42.42.5(pid=3307): stdout: | (launched: 2022-12-10_11:40:19.202691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:20.759080 run osmo-stp_10.42.42.5(pid=3307): stderr: | 20221210114019396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114019396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114019396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114019396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114019397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114019397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114019397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:20.894372 run osmo-stp_10.42.42.5(pid=3307): stdout: | (launched: 2022-12-10_11:40:19.202691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:21.024199 run osmo-stp_10.42.42.5(pid=3307): stderr: | 20221210114019396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114019396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114019396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114019396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114019397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114019397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114019397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:21.177868 run patchelf(pid=3310): Terminating (SIGINT) 11:40:21.353994 run patchelf(pid=3310): Terminated: ok {rc=0} 11:40:21.481522 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3307): Process ended prematurely: osmo-stp_10.42.42.5(pid=3307) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3307)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 11:40:21.491199 tst ping.py:22: Test FAILED (6.6 sec) 11:40:21.519186 run osmo-hlr_10.42.42.2(pid=3304): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3304)] 11:40:21.569202 run osmo-hlr_10.42.42.2(pid=3304): stdout: | (launched: 2022-12-10_11:40:18.215276) 11:40:21.620715 run osmo-hlr_10.42.42.2(pid=3304): stderr: | 20221210114018412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114018412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114018413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114018413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114018413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114018413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114018426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114018434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114018434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114018434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:21.672881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3303): Terminating (SIGTERM) 11:40:21.714604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3306): Terminating (SIGTERM) 11:40:21.756358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3309): Terminating (SIGTERM) 11:40:21.798395 --- ParallelTerminationStrategy: PID 3303 died... 11:40:21.818349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3303): Terminated: ok {rc=0} 11:40:21.864467 --- ParallelTerminationStrategy: PID 3306 died... 11:40:21.884054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3306): Terminated: ok {rc=0} 11:40:21.929741 --- ParallelTerminationStrategy: PID 3309 died... 11:40:21.949231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3309): Terminated: ok {rc=0} 11:40:22.035937 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:40:23.124077 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.136138 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:40:23.207600 tst ping_idle_ping.py: using LAC 28140 11:40:23.332023 tst ping_idle_ping.py: using RAC 90 11:40:23.457110 tst ping_idle_ping.py: using CellId 28140 11:40:23.583028 tst ping_idle_ping.py: using BVCI 28141 11:40:23.698132 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.709770 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.721008 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.732299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.743513 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.754635 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.766016 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:23.777203 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:40:23.894596 tst ping_idle_ping.py:24: start network... 11:40:24.109575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:24.610971 run create_hlr_db(pid=3311): Launched 11:40:24.739602 bus /gobi_6: Setting Powered False 11:40:25.802255 run create_hlr_db(pid=3311): Terminated: ok {rc=0} 11:40:26.226465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3313): Launched 11:40:26.522664 run osmo-hlr_10.42.42.2(pid=3314): Launched 11:40:26.637620 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:27.162815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3316): Launched 11:40:27.458022 run osmo-stp_10.42.42.5(pid=3317): Launched 11:40:27.574096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:28.085165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3319): Launched 11:40:28.198539 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:28.448886 run patchelf(pid=3320): Launched 11:40:28.614015 run osmo-stp_10.42.42.5(pid=3317): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3317)] 11:40:28.739534 run osmo-stp_10.42.42.5(pid=3317): stdout: | (launched: 2022-12-10_11:40:27.404282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:28.866565 run osmo-stp_10.42.42.5(pid=3317): stderr: | 20221210114027571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114027571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114027572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114027572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114027573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114027573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114027573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:28.993182 run osmo-stp_10.42.42.5(pid=3317): stdout: | (launched: 2022-12-10_11:40:27.404282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:29.114605 run osmo-stp_10.42.42.5(pid=3317): stderr: | 20221210114027571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114027571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114027572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114027572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114027573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114027573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114027573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:29.258338 run patchelf(pid=3320): Terminating (SIGINT) 11:40:29.424378 run patchelf(pid=3320): Terminated: ok {rc=0} 11:40:29.543740 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3317): Process ended prematurely: osmo-stp_10.42.42.5(pid=3317) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3317)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:40:29.552559 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:40:29.579346 run osmo-hlr_10.42.42.2(pid=3314): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3314)] 11:40:29.626811 run osmo-hlr_10.42.42.2(pid=3314): stdout: | (launched: 2022-12-10_11:40:26.468469) 11:40:29.676406 run osmo-hlr_10.42.42.2(pid=3314): stderr: | 20221210114026641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114026641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114026641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114026641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114026641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114026642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114026654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114026662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114026663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114026663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:29.725691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3313): Terminating (SIGTERM) 11:40:29.765689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3316): Terminating (SIGTERM) 11:40:29.805303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3319): Terminating (SIGTERM) 11:40:29.845017 --- ParallelTerminationStrategy: PID 3313 died... 11:40:29.863988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3313): Terminated: ok {rc=0} 11:40:29.908065 --- ParallelTerminationStrategy: PID 3316 died... 11:40:29.926765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3316): Terminated: ok {rc=0} 11:40:29.970974 --- ParallelTerminationStrategy: PID 3319 died... 11:40:29.989522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3319): Terminated: ok {rc=0} 11:40:30.075418 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:40:31.412638 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:40:31.419818 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:40:31.456056 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:40:31.496283 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:40:31.586772 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:40:31.631434 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:40:31.692005 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:40:32.272237 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:40:32.327739 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.339235 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:40:32.415343 tst cs_paging_gprs_active.py: using LAC 28141 11:40:32.540888 tst cs_paging_gprs_active.py: using RAC 91 11:40:32.665257 tst cs_paging_gprs_active.py: using CellId 28141 11:40:32.789819 tst cs_paging_gprs_active.py: using BVCI 28142 11:40:32.907319 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.918742 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.929805 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.941406 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.952835 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.964440 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.976110 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.987519 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:32.999156 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:40:33.115308 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:40:33.233108 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:40:33.453505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:33.777174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3324): Launched 11:40:34.057291 run iperf3-srv_10.42.42.10(pid=3325): Launched 11:40:34.178671 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:40:34.398036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:34.722449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3326): Launched 11:40:35.002731 run iperf3-srv_10.42.42.10(pid=3327): Launched 11:40:35.124016 tst cs_paging_gprs_active.py:38: start network... 11:40:35.341720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:35.841509 run create_hlr_db(pid=3328): Launched 11:40:35.972838 bus /gobi_6: Setting Powered False 11:40:37.037561 run create_hlr_db(pid=3328): Terminated: ok {rc=0} 11:40:37.487064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3330): Launched 11:40:37.809268 run osmo-hlr_10.42.42.2(pid=3331): Launched 11:40:37.932207 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:38.485964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3333): Launched 11:40:38.806929 run osmo-stp_10.42.42.5(pid=3334): Launched 11:40:38.929474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:39.482863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3336): Launched 11:40:39.606251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:39.877353 run patchelf(pid=3337): Launched 11:40:40.056549 run osmo-stp_10.42.42.5(pid=3334): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3334)] 11:40:40.193114 run osmo-stp_10.42.42.5(pid=3334): stdout: | (launched: 2022-12-10_11:40:38.748695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:40.331103 run osmo-stp_10.42.42.5(pid=3334): stderr: | 20221210114038943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114038943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114038943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114038944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114038944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114038944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114038944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:40.470313 run osmo-stp_10.42.42.5(pid=3334): stdout: | (launched: 2022-12-10_11:40:38.748695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:40.601995 run osmo-stp_10.42.42.5(pid=3334): stderr: | 20221210114038943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114038943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114038943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114038944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114038944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114038944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114038944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:40.758560 run patchelf(pid=3337): Terminating (SIGINT) 11:40:40.938585 run patchelf(pid=3337): Terminated: ok {rc=0} 11:40:41.068687 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3334): Process ended prematurely: osmo-stp_10.42.42.5(pid=3334) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3334)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:40:41.078787 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:40:41.106928 run osmo-hlr_10.42.42.2(pid=3331): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3331)] 11:40:41.156480 run osmo-hlr_10.42.42.2(pid=3331): stdout: | (launched: 2022-12-10_11:40:37.750926) 11:40:41.207668 run osmo-hlr_10.42.42.2(pid=3331): stderr: | 20221210114037949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114037949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114037949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114037949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114037949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114037949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114037961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114037969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114037969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114037969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:41.259152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3324): Terminating (SIGTERM) 11:40:41.300398 run iperf3-srv_10.42.42.10(pid=3325): Terminating (SIGTERM) 11:40:41.341580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3326): Terminating (SIGTERM) 11:40:41.383122 run iperf3-srv_10.42.42.10(pid=3327): Terminating (SIGTERM) 11:40:41.424374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3330): Terminating (SIGTERM) 11:40:41.465593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3333): Terminating (SIGTERM) 11:40:41.506570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3336): Terminating (SIGTERM) 11:40:41.547904 --- ParallelTerminationStrategy: PID 3324 died... 11:40:41.567622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3324): Terminated: ok {rc=0} 11:40:41.613315 --- ParallelTerminationStrategy: PID 3325 died... 11:40:41.632469 run iperf3-srv_10.42.42.10(pid=3325): Terminated {rc=256} 11:40:41.677805 --- ParallelTerminationStrategy: PID 3326 died... 11:40:41.697135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3326): Terminated: ok {rc=0} 11:40:41.742370 --- ParallelTerminationStrategy: PID 3327 died... 11:40:41.761510 run iperf3-srv_10.42.42.10(pid=3327): Terminated {rc=256} 11:40:41.806834 --- ParallelTerminationStrategy: PID 3330 died... 11:40:41.826040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3330): Terminated: ok {rc=0} 11:40:41.871521 --- ParallelTerminationStrategy: PID 3333 died... 11:40:41.890899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3333): Terminated: ok {rc=0} 11:40:41.937132 --- ParallelTerminationStrategy: PID 3336 died... 11:40:41.956802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3336): Terminated: ok {rc=0} 11:40:42.043636 bus /gobi_0: Setting Powered False 11:40:43.142729 bus /gobi_0: Setting Powered False 11:40:44.259070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:40:45.404117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:45.415624 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:40:45.492797 tst iperf3.py: using LAC 28142 11:40:45.610292 tst iperf3.py: using RAC 92 11:40:45.728000 tst iperf3.py: using CellId 28142 11:40:45.844607 tst iperf3.py: using BVCI 28143 11:40:45.982858 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:45.994697 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:46.006413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:46.018847 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:46.031847 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:46.044198 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:46.056885 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:46.068327 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:46.080361 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:40:46.200657 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:46.426092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:46.761483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3338): Launched 11:40:47.062366 run iperf3-srv_10.42.42.10(pid=3339): Launched 11:40:47.194127 tst iperf3.py:8: start network... 11:40:47.411743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:47.909753 run create_hlr_db(pid=3340): Launched 11:40:48.040712 bus /gobi_6: Setting Powered False 11:40:49.104097 run create_hlr_db(pid=3340): Terminated: ok {rc=0} 11:40:49.551088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3342): Launched 11:40:49.870469 run osmo-hlr_10.42.42.2(pid=3343): Launched 11:40:49.992264 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:50.551291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3345): Launched 11:40:50.871991 run osmo-stp_10.42.42.5(pid=3346): Launched 11:40:50.994199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:51.547966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3348): Launched 11:40:51.670741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:51.941573 run patchelf(pid=3349): Launched 11:40:52.120541 run osmo-stp_10.42.42.5(pid=3346): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3346)] 11:40:52.256766 run osmo-stp_10.42.42.5(pid=3346): stdout: | (launched: 2022-12-10_11:40:50.813873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:52.395314 run osmo-stp_10.42.42.5(pid=3346): stderr: | 20221210114051005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114051005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114051006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114051006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114051008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114051008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114051009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:52.533921 run osmo-stp_10.42.42.5(pid=3346): stdout: | (launched: 2022-12-10_11:40:50.813873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:52.666243 run osmo-stp_10.42.42.5(pid=3346): stderr: | 20221210114051005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114051005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114051006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114051006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114051008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114051008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114051009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:52.822495 run patchelf(pid=3349): Terminating (SIGINT) 11:40:53.002914 run patchelf(pid=3349): Terminated: ok {rc=0} 11:40:53.132762 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3346): Process ended prematurely: osmo-stp_10.42.42.5(pid=3346) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3346)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 11:40:53.142855 tst iperf3.py:8: Test FAILED (7.8 sec) 11:40:53.171172 run osmo-hlr_10.42.42.2(pid=3343): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3343)] 11:40:53.221764 run osmo-hlr_10.42.42.2(pid=3343): stdout: | (launched: 2022-12-10_11:40:49.812377) 11:40:53.273716 run osmo-hlr_10.42.42.2(pid=3343): stderr: | 20221210114050009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114050009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114050009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114050009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114050009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114050009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114050022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114050031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114050031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114050031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:53.325889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3338): Terminating (SIGTERM) 11:40:53.367628 run iperf3-srv_10.42.42.10(pid=3339): Terminating (SIGTERM) 11:40:53.409642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3342): Terminating (SIGTERM) 11:40:53.451444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3345): Terminating (SIGTERM) 11:40:53.493051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3348): Terminating (SIGTERM) 11:40:53.535098 --- ParallelTerminationStrategy: PID 3338 died... 11:40:53.554932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3338): Terminated: ok {rc=0} 11:40:53.600723 --- ParallelTerminationStrategy: PID 3339 died... 11:40:53.620152 run iperf3-srv_10.42.42.10(pid=3339): Terminated {rc=256} 11:40:53.665755 --- ParallelTerminationStrategy: PID 3342 died... 11:40:53.685058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3342): Terminated: ok {rc=0} 11:40:53.730468 --- ParallelTerminationStrategy: PID 3345 died... 11:40:53.749859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3345): Terminated: ok {rc=0} 11:40:53.795317 --- ParallelTerminationStrategy: PID 3348 died... 11:40:53.814631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3348): Terminated: ok {rc=0} 11:40:53.901153 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:40:55.050855 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.062683 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:40:55.133475 tst iperf3m4.py: using LAC 28143 11:40:55.264410 tst iperf3m4.py: using RAC 93 11:40:55.389860 tst iperf3m4.py: using CellId 28143 11:40:55.514416 tst iperf3m4.py: using BVCI 28144 11:40:55.630906 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.642121 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.653196 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.664139 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.675080 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.686149 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.697368 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.708305 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:40:55.719463 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:40:55.833458 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:40:55.954287 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:40:56.075056 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:40:56.195190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:56.412309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:56.733862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3350): Launched 11:40:57.012129 run iperf3-srv_10.42.42.10(pid=3351): Launched 11:40:57.132521 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:40:57.348602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:57.670031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3352): Launched 11:40:57.947954 run iperf3-srv_10.42.42.10(pid=3353): Launched 11:40:58.068362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:40:58.284084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:58.606030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3354): Launched 11:40:58.884084 run iperf3-srv_10.42.42.10(pid=3355): Launched 11:40:59.004016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:40:59.219768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:59.540891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3356): Launched 11:40:59.818926 run iperf3-srv_10.42.42.10(pid=3357): Launched 11:40:59.938658 tst iperf3m4.py:8: start network... 11:41:00.154406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:00.653424 run create_hlr_db(pid=3358): Launched 11:41:00.783971 bus /gobi_6: Setting Powered False 11:41:01.844230 run create_hlr_db(pid=3358): Terminated: ok {rc=0} 11:41:02.350198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3360): Launched 11:41:02.673128 run osmo-hlr_10.42.42.2(pid=3361): Launched 11:41:02.795514 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:03.347837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3363): Launched 11:41:03.669316 run osmo-stp_10.42.42.5(pid=3364): Launched 11:41:03.790762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:04.342067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3366): Launched 11:41:04.465955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:04.737708 run patchelf(pid=3367): Launched 11:41:04.916698 run osmo-stp_10.42.42.5(pid=3364): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3364)] 11:41:05.053115 run osmo-stp_10.42.42.5(pid=3364): stdout: | (launched: 2022-12-10_11:41:03.610748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:05.191239 run osmo-stp_10.42.42.5(pid=3364): stderr: | 20221210114103802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114103802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114103802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114103802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114103803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114103803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114103803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:05.329297 run osmo-stp_10.42.42.5(pid=3364): stdout: | (launched: 2022-12-10_11:41:03.610748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:05.461620 run osmo-stp_10.42.42.5(pid=3364): stderr: | 20221210114103802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114103802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114103802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114103802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114103803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114103803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114103803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:05.618177 run patchelf(pid=3367): Terminating (SIGINT) 11:41:05.798591 run patchelf(pid=3367): Terminated: ok {rc=0} 11:41:05.928279 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3364): Process ended prematurely: osmo-stp_10.42.42.5(pid=3364) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3364)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:41:05.938304 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:41:05.966847 run osmo-hlr_10.42.42.2(pid=3361): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3361)] 11:41:06.016901 run osmo-hlr_10.42.42.2(pid=3361): stdout: | (launched: 2022-12-10_11:41:02.614300) 11:41:06.068450 run osmo-hlr_10.42.42.2(pid=3361): stderr: | 20221210114102813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114102813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114102813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114102813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114102813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114102813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114102826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114102834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114102835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114102835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:06.120536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3350): Terminating (SIGTERM) 11:41:06.162303 run iperf3-srv_10.42.42.10(pid=3351): Terminating (SIGTERM) 11:41:06.203977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3352): Terminating (SIGTERM) 11:41:06.245736 run iperf3-srv_10.42.42.10(pid=3353): Terminating (SIGTERM) 11:41:06.287298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3354): Terminating (SIGTERM) 11:41:06.329189 run iperf3-srv_10.42.42.10(pid=3355): Terminating (SIGTERM) 11:41:06.370800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3356): Terminating (SIGTERM) 11:41:06.412904 run iperf3-srv_10.42.42.10(pid=3357): Terminating (SIGTERM) 11:41:06.454630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3360): Terminating (SIGTERM) 11:41:06.496343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3363): Terminating (SIGTERM) 11:41:06.538127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3366): Terminating (SIGTERM) 11:41:06.580029 --- ParallelTerminationStrategy: PID 3350 died... 11:41:06.600037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3350): Terminated: ok {rc=0} 11:41:06.646941 --- ParallelTerminationStrategy: PID 3351 died... 11:41:06.666441 run iperf3-srv_10.42.42.10(pid=3351): Terminated {rc=256} 11:41:06.712563 --- ParallelTerminationStrategy: PID 3352 died... 11:41:06.731998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3352): Terminated: ok {rc=0} 11:41:06.777982 --- ParallelTerminationStrategy: PID 3353 died... 11:41:06.797363 run iperf3-srv_10.42.42.10(pid=3353): Terminated {rc=256} 11:41:06.842844 --- ParallelTerminationStrategy: PID 3354 died... 11:41:06.862164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3354): Terminated: ok {rc=0} 11:41:06.907868 --- ParallelTerminationStrategy: PID 3355 died... 11:41:06.927238 run iperf3-srv_10.42.42.10(pid=3355): Terminated {rc=256} 11:41:06.973097 --- ParallelTerminationStrategy: PID 3356 died... 11:41:06.992636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3356): Terminated: ok {rc=0} 11:41:07.038759 --- ParallelTerminationStrategy: PID 3357 died... 11:41:07.058226 run iperf3-srv_10.42.42.10(pid=3357): Terminated {rc=256} 11:41:07.104104 --- ParallelTerminationStrategy: PID 3360 died... 11:41:07.123543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3360): Terminated: ok {rc=0} 11:41:07.169670 --- ParallelTerminationStrategy: PID 3363 died... 11:41:07.189255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3363): Terminated: ok {rc=0} 11:41:07.235239 --- ParallelTerminationStrategy: PID 3366 died... 11:41:07.254933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3366): Terminated: ok {rc=0} 11:41:07.342037 bus /gobi_4: Setting Powered False 11:41:08.440528 bus /gobi_4: Setting Powered False 11:41:09.557771 bus /gobi_1: Setting Powered False 11:41:10.656326 bus /gobi_1: Setting Powered False 11:41:11.773787 bus /gobi_0: Setting Powered False 11:41:12.871802 bus /gobi_0: Setting Powered False 11:41:13.988323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:41:15.090888 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.102783 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:41:15.174648 tst ping.py: using LAC 28144 11:41:15.304588 tst ping.py: using RAC 94 11:41:15.427425 tst ping.py: using CellId 28144 11:41:15.544456 tst ping.py: using BVCI 28145 11:41:15.651966 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.662948 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.673899 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.685623 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.696558 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.707475 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.718519 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:15.729641 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:41:15.861317 tst ping.py:19: start network... 11:41:16.085088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:16.586266 run create_hlr_db(pid=3368): Launched 11:41:16.723597 bus /gobi_6: Setting Powered False 11:41:17.786072 run create_hlr_db(pid=3368): Terminated: ok {rc=0} 11:41:18.210686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3370): Launched 11:41:18.507150 run osmo-hlr_10.42.42.2(pid=3371): Launched 11:41:18.620468 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:19.147112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3373): Launched 11:41:19.441466 run osmo-stp_10.42.42.5(pid=3374): Launched 11:41:19.554233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:20.063492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3376): Launched 11:41:20.176766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:20.426325 run patchelf(pid=3377): Launched 11:41:20.603394 run osmo-stp_10.42.42.5(pid=3374): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3374)] 11:41:20.737198 run osmo-stp_10.42.42.5(pid=3374): stdout: | (launched: 2022-12-10_11:41:19.387353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:20.872618 run osmo-stp_10.42.42.5(pid=3374): stderr: | 20221210114119557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114119557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114119557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114119558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114119558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114119558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114119558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:21.007702 run osmo-stp_10.42.42.5(pid=3374): stdout: | (launched: 2022-12-10_11:41:19.387353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:21.137574 run osmo-stp_10.42.42.5(pid=3374): stderr: | 20221210114119557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114119557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114119557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114119558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114119558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114119558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114119558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:21.290983 run patchelf(pid=3377): Terminating (SIGINT) 11:41:21.467888 run patchelf(pid=3377): Terminated: ok {rc=0} 11:41:21.594857 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3374): Process ended prematurely: osmo-stp_10.42.42.5(pid=3374) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3374)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 11:41:21.604178 tst ping.py:22: Test FAILED (6.5 sec) 11:41:21.632206 run osmo-hlr_10.42.42.2(pid=3371): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3371)] 11:41:21.681983 run osmo-hlr_10.42.42.2(pid=3371): stdout: | (launched: 2022-12-10_11:41:18.452785) 11:41:21.733294 run osmo-hlr_10.42.42.2(pid=3371): stderr: | 20221210114118626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114118626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114118626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114118626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114118626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114118626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114118638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114118647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114118647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114118647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:21.785266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3370): Terminating (SIGTERM) 11:41:21.826744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3373): Terminating (SIGTERM) 11:41:21.868385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3376): Terminating (SIGTERM) 11:41:21.910292 --- ParallelTerminationStrategy: PID 3370 died... 11:41:21.930226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3370): Terminated: ok {rc=0} 11:41:21.976075 --- ParallelTerminationStrategy: PID 3373 died... 11:41:21.995449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3373): Terminated: ok {rc=0} 11:41:22.041239 --- ParallelTerminationStrategy: PID 3376 died... 11:41:22.060701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3376): Terminated: ok {rc=0} 11:41:22.147622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:41:23.235176 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.246888 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:41:23.323627 tst ping_idle_ping.py: using LAC 28145 11:41:23.448202 tst ping_idle_ping.py: using RAC 95 11:41:23.570403 tst ping_idle_ping.py: using CellId 28145 11:41:23.697563 tst ping_idle_ping.py: using BVCI 28146 11:41:23.808439 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.819454 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.830269 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.841909 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.853348 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.864624 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.876139 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:23.887495 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:41:24.005321 tst ping_idle_ping.py:24: start network... 11:41:24.219952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:24.714126 run create_hlr_db(pid=3378): Launched 11:41:24.842821 bus /gobi_6: Setting Powered False 11:41:25.905926 run create_hlr_db(pid=3378): Terminated: ok {rc=0} 11:41:26.330528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3380): Launched 11:41:26.628532 run osmo-hlr_10.42.42.2(pid=3381): Launched 11:41:26.743299 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:27.268689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3383): Launched 11:41:27.564796 run osmo-stp_10.42.42.5(pid=3384): Launched 11:41:27.678728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:28.204509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3386): Launched 11:41:28.317695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:28.566931 run patchelf(pid=3387): Launched 11:41:28.731495 run osmo-stp_10.42.42.5(pid=3384): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3384)] 11:41:28.857087 run osmo-stp_10.42.42.5(pid=3384): stdout: | (launched: 2022-12-10_11:41:27.510871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:28.983943 run osmo-stp_10.42.42.5(pid=3384): stderr: | 20221210114127681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114127681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114127682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114127682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114127683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114127683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114127683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:29.110964 run osmo-stp_10.42.42.5(pid=3384): stdout: | (launched: 2022-12-10_11:41:27.510871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:29.232051 run osmo-stp_10.42.42.5(pid=3384): stderr: | 20221210114127681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114127681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114127682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114127682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114127683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114127683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114127683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:29.375730 run patchelf(pid=3387): Terminating (SIGINT) 11:41:29.541499 run patchelf(pid=3387): Terminated: ok {rc=0} 11:41:29.660721 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3384): Process ended prematurely: osmo-stp_10.42.42.5(pid=3384) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3384)] [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:41:29.669642 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:41:29.696660 run osmo-hlr_10.42.42.2(pid=3381): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3381)] 11:41:29.744520 run osmo-hlr_10.42.42.2(pid=3381): stdout: | (launched: 2022-12-10_11:41:26.573499) 11:41:29.794009 run osmo-hlr_10.42.42.2(pid=3381): stderr: | 20221210114126748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114126748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114126748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114126748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114126748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114126748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114126759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114126768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114126768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114126768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:29.844057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3380): Terminating (SIGTERM) 11:41:29.884266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3383): Terminating (SIGTERM) 11:41:29.924264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3386): Terminating (SIGTERM) 11:41:29.964323 --- ParallelTerminationStrategy: PID 3380 died... 11:41:29.983174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3380): Terminated: ok {rc=0} 11:41:30.028256 --- ParallelTerminationStrategy: PID 3383 died... 11:41:30.046872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3383): Terminated: ok {rc=0} 11:41:30.091252 --- ParallelTerminationStrategy: PID 3386 died... 11:41:30.110004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3386): Terminated: ok {rc=0} 11:41:30.193848 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:41:31.539823 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:41:31.546756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:41:31.583660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:41:31.623487 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:41:31.711432 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:41:31.746032 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:41:31.786494 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:41:32.377836 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:41:32.428256 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:32.439583 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:41:32.492320 tst cs_paging_gprs_active.py: using LAC 28146 11:41:32.611280 tst cs_paging_gprs_active.py: using RAC 96 11:41:32.731301 tst cs_paging_gprs_active.py: using CellId 28146 11:41:32.851771 tst cs_paging_gprs_active.py: using BVCI 28147 11:41:32.971352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:32.982972 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:32.994375 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:33.005773 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:33.017231 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:33.028705 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:33.040205 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:33.051482 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:33.063123 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:41:33.178056 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:41:33.293851 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:41:33.498435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:33.802650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3391): Launched 11:41:34.065722 run iperf3-srv_10.42.42.10(pid=3392): Launched 11:41:34.179089 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:41:34.382108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:34.685110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3393): Launched 11:41:34.949378 run iperf3-srv_10.42.42.10(pid=3394): Launched 11:41:35.063393 tst cs_paging_gprs_active.py:38: start network... 11:41:35.266171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:35.732915 run create_hlr_db(pid=3395): Launched 11:41:35.849546 bus /gobi_6: Setting Powered False 11:41:36.910264 run create_hlr_db(pid=3395): Terminated: ok {rc=0} 11:41:37.350276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3397): Launched 11:41:37.673619 run osmo-hlr_10.42.42.2(pid=3398): Launched 11:41:37.797682 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:38.355122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3400): Launched 11:41:38.686432 run osmo-stp_10.42.42.5(pid=3401): Launched 11:41:38.809736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:39.366529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3403): Launched 11:41:39.490958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:39.763443 run patchelf(pid=3404): Launched 11:41:39.943096 run osmo-stp_10.42.42.5(pid=3401): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3401)] 11:41:40.080201 run osmo-stp_10.42.42.5(pid=3401): stdout: | (launched: 2022-12-10_11:41:38.627855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:40.218528 run osmo-stp_10.42.42.5(pid=3401): stderr: | 20221210114138818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114138818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114138819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114138819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114138821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114138821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114138821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:40.356636 run osmo-stp_10.42.42.5(pid=3401): stdout: | (launched: 2022-12-10_11:41:38.627855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:40.489177 run osmo-stp_10.42.42.5(pid=3401): stderr: | 20221210114138818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114138818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114138819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114138819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114138821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114138821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114138821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:40.646140 run patchelf(pid=3404): Terminating (SIGINT) 11:41:40.826271 run patchelf(pid=3404): Terminated: ok {rc=0} 11:41:40.957226 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3401): Process ended prematurely: osmo-stp_10.42.42.5(pid=3401) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3401)] [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:41:40.967318 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:41:40.995816 run osmo-hlr_10.42.42.2(pid=3398): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3398)] 11:41:41.045558 run osmo-hlr_10.42.42.2(pid=3398): stdout: | (launched: 2022-12-10_11:41:37.615344) 11:41:41.096794 run osmo-hlr_10.42.42.2(pid=3398): stderr: | 20221210114137814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114137814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114137814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114137814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114137814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114137814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114137827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114137835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114137835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114137835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:41.148810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3391): Terminating (SIGTERM) 11:41:41.190300 run iperf3-srv_10.42.42.10(pid=3392): Terminating (SIGTERM) 11:41:41.231889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3393): Terminating (SIGTERM) 11:41:41.273593 run iperf3-srv_10.42.42.10(pid=3394): Terminating (SIGTERM) 11:41:41.315598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3397): Terminating (SIGTERM) 11:41:41.357458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3400): Terminating (SIGTERM) 11:41:41.398954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3403): Terminating (SIGTERM) 11:41:41.441172 --- ParallelTerminationStrategy: PID 3391 died... 11:41:41.461201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3391): Terminated: ok {rc=0} 11:41:41.507375 --- ParallelTerminationStrategy: PID 3392 died... 11:41:41.526975 run iperf3-srv_10.42.42.10(pid=3392): Terminated {rc=256} 11:41:41.573065 --- ParallelTerminationStrategy: PID 3393 died... 11:41:41.592532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3393): Terminated: ok {rc=0} 11:41:41.638415 --- ParallelTerminationStrategy: PID 3394 died... 11:41:41.657757 run iperf3-srv_10.42.42.10(pid=3394): Terminated {rc=256} 11:41:41.703312 --- ParallelTerminationStrategy: PID 3397 died... 11:41:41.722674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3397): Terminated: ok {rc=0} 11:41:41.768086 --- ParallelTerminationStrategy: PID 3400 died... 11:41:41.787420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3400): Terminated: ok {rc=0} 11:41:41.832911 --- ParallelTerminationStrategy: PID 3403 died... 11:41:41.852748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3403): Terminated: ok {rc=0} 11:41:41.940574 bus /gobi_0: Setting Powered False 11:41:43.040385 bus /gobi_0: Setting Powered False 11:41:44.156365 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:41:45.304655 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.316895 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:41:45.373380 tst iperf3.py: using LAC 28147 11:41:45.500897 tst iperf3.py: using RAC 97 11:41:45.626606 tst iperf3.py: using CellId 28147 11:41:45.746252 tst iperf3.py: using BVCI 28148 11:41:45.859020 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.871407 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.883026 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.897633 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.909916 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.934992 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.947895 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.960584 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:45.973551 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:41:46.111312 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:46.363732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:46.699541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3405): Launched 11:41:47.002630 run iperf3-srv_10.42.42.10(pid=3406): Launched 11:41:47.128308 tst iperf3.py:8: start network... 11:41:47.348667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:47.848319 run create_hlr_db(pid=3407): Launched 11:41:47.979687 bus /gobi_6: Setting Powered False 11:41:49.043050 run create_hlr_db(pid=3407): Terminated: ok {rc=0} 11:41:49.490714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3409): Launched 11:41:49.811654 run osmo-hlr_10.42.42.2(pid=3410): Launched 11:41:49.933714 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:50.491782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3412): Launched 11:41:50.813145 run osmo-stp_10.42.42.5(pid=3413): Launched 11:41:50.935190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:51.490288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3415): Launched 11:41:51.613932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:51.886136 run patchelf(pid=3416): Launched 11:41:52.065174 run osmo-stp_10.42.42.5(pid=3413): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3413)] 11:41:52.201527 run osmo-stp_10.42.42.5(pid=3413): stdout: | (launched: 2022-12-10_11:41:50.754923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:52.339467 run osmo-stp_10.42.42.5(pid=3413): stderr: | 20221210114150947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114150947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114150947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114150947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114150950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114150950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114150950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:52.478195 run osmo-stp_10.42.42.5(pid=3413): stdout: | (launched: 2022-12-10_11:41:50.754923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:52.609871 run osmo-stp_10.42.42.5(pid=3413): stderr: | 20221210114150947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114150947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114150947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114150947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114150950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114150950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114150950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:52.766110 run patchelf(pid=3416): Terminating (SIGINT) 11:41:52.946066 run patchelf(pid=3416): Terminated: ok {rc=0} 11:41:53.076329 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3413): Process ended prematurely: osmo-stp_10.42.42.5(pid=3413) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3413)] [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:41:53.086408 tst iperf3.py:8: Test FAILED (7.8 sec) 11:41:53.114694 run osmo-hlr_10.42.42.2(pid=3410): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3410)] 11:41:53.164143 run osmo-hlr_10.42.42.2(pid=3410): stdout: | (launched: 2022-12-10_11:41:49.753329) 11:41:53.215169 run osmo-hlr_10.42.42.2(pid=3410): stderr: | 20221210114149951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114149951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114149951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114149951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114149951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114149951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114149964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114149972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114149973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114149973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:53.266713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3405): Terminating (SIGTERM) 11:41:53.308065 run iperf3-srv_10.42.42.10(pid=3406): Terminating (SIGTERM) 11:41:53.349564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3409): Terminating (SIGTERM) 11:41:53.391082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3412): Terminating (SIGTERM) 11:41:53.432857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3415): Terminating (SIGTERM) 11:41:53.474697 --- ParallelTerminationStrategy: PID 3405 died... 11:41:53.494701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3405): Terminated: ok {rc=0} 11:41:53.540789 --- ParallelTerminationStrategy: PID 3406 died... 11:41:53.560373 run iperf3-srv_10.42.42.10(pid=3406): Terminated {rc=256} 11:41:53.605948 --- ParallelTerminationStrategy: PID 3409 died... 11:41:53.625365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3409): Terminated: ok {rc=0} 11:41:53.670878 --- ParallelTerminationStrategy: PID 3412 died... 11:41:53.690235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3412): Terminated: ok {rc=0} 11:41:53.735719 --- ParallelTerminationStrategy: PID 3415 died... 11:41:53.755080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3415): Terminated: ok {rc=0} 11:41:53.842224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:41:54.985997 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:54.997902 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:41:55.050291 tst iperf3m4.py: using LAC 28148 11:41:55.176838 tst iperf3m4.py: using RAC 98 11:41:55.303424 tst iperf3m4.py: using CellId 28148 11:41:55.432886 tst iperf3m4.py: using BVCI 28149 11:41:55.550702 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.562562 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.574154 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.585777 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.597279 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.608632 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.620171 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.631495 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:41:55.643110 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:41:55.763999 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:41:55.882253 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:41:56.002274 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:41:56.117336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:56.321528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:56.626272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3417): Launched 11:41:56.889600 run iperf3-srv_10.42.42.10(pid=3418): Launched 11:41:57.005483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:41:57.209770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:57.513431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3419): Launched 11:41:57.776375 run iperf3-srv_10.42.42.10(pid=3420): Launched 11:41:57.890606 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:41:58.093952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:58.395946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3421): Launched 11:41:58.658649 run iperf3-srv_10.42.42.10(pid=3422): Launched 11:41:58.771919 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:41:58.973972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:59.275586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3423): Launched 11:41:59.537742 run iperf3-srv_10.42.42.10(pid=3424): Launched 11:41:59.650985 tst iperf3m4.py:8: start network... 11:41:59.852419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:00.316531 run create_hlr_db(pid=3425): Launched 11:42:00.433390 bus /gobi_6: Setting Powered False 11:42:01.491749 run create_hlr_db(pid=3425): Terminated: ok {rc=0} 11:42:01.968227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3434): Launched 11:42:02.304245 run osmo-hlr_10.42.42.2(pid=3435): Launched 11:42:02.428425 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:02.988399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3437): Launched 11:42:03.309675 run osmo-stp_10.42.42.5(pid=3438): Launched 11:42:03.432280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:03.985224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3440): Launched 11:42:04.107842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:04.379177 run patchelf(pid=3441): Launched 11:42:04.558560 run osmo-stp_10.42.42.5(pid=3438): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3438)] 11:42:04.694110 run osmo-stp_10.42.42.5(pid=3438): stdout: | (launched: 2022-12-10_11:42:03.250939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:04.831245 run osmo-stp_10.42.42.5(pid=3438): stderr: | 20221210114203446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114203446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114203446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114203447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114203447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114203447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114203447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:04.968443 run osmo-stp_10.42.42.5(pid=3438): stdout: | (launched: 2022-12-10_11:42:03.250939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:05.099849 run osmo-stp_10.42.42.5(pid=3438): stderr: | 20221210114203446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114203446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114203446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114203447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114203447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114203447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114203447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:05.255678 run patchelf(pid=3441): Terminating (SIGINT) 11:42:05.435776 run patchelf(pid=3441): Terminated: ok {rc=0} 11:42:05.565493 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3438): Process ended prematurely: osmo-stp_10.42.42.5(pid=3438) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3438)] [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:42:05.575607 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:42:05.604129 run osmo-hlr_10.42.42.2(pid=3435): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3435)] 11:42:05.653485 run osmo-hlr_10.42.42.2(pid=3435): stdout: | (launched: 2022-12-10_11:42:02.245589) 11:42:05.704447 run osmo-hlr_10.42.42.2(pid=3435): stderr: | 20221210114202444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114202444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114202444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114202444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114202444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114202444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114202455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114202463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114202464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114202464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:05.755636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3417): Terminating (SIGTERM) 11:42:05.796757 run iperf3-srv_10.42.42.10(pid=3418): Terminating (SIGTERM) 11:42:05.837888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3419): Terminating (SIGTERM) 11:42:05.879086 run iperf3-srv_10.42.42.10(pid=3420): Terminating (SIGTERM) 11:42:05.920116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3421): Terminating (SIGTERM) 11:42:05.961382 run iperf3-srv_10.42.42.10(pid=3422): Terminating (SIGTERM) 11:42:06.003788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3423): Terminating (SIGTERM) 11:42:06.045697 run iperf3-srv_10.42.42.10(pid=3424): Terminating (SIGTERM) 11:42:06.086790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3434): Terminating (SIGTERM) 11:42:06.127762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3437): Terminating (SIGTERM) 11:42:06.168620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3440): Terminating (SIGTERM) 11:42:06.209899 --- ParallelTerminationStrategy: PID 3417 died... 11:42:06.229606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3417): Terminated: ok {rc=0} 11:42:06.275031 --- ParallelTerminationStrategy: PID 3418 died... 11:42:06.294110 run iperf3-srv_10.42.42.10(pid=3418): Terminated {rc=256} 11:42:06.339372 --- ParallelTerminationStrategy: PID 3419 died... 11:42:06.358734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3419): Terminated: ok {rc=0} 11:42:06.403872 --- ParallelTerminationStrategy: PID 3420 died... 11:42:06.423371 run iperf3-srv_10.42.42.10(pid=3420): Terminated {rc=256} 11:42:06.469189 --- ParallelTerminationStrategy: PID 3421 died... 11:42:06.488301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3421): Terminated: ok {rc=0} 11:42:06.533808 --- ParallelTerminationStrategy: PID 3422 died... 11:42:06.553009 run iperf3-srv_10.42.42.10(pid=3422): Terminated {rc=256} 11:42:06.598230 --- ParallelTerminationStrategy: PID 3423 died... 11:42:06.617552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3423): Terminated: ok {rc=0} 11:42:06.662841 --- ParallelTerminationStrategy: PID 3424 died... 11:42:06.682065 run iperf3-srv_10.42.42.10(pid=3424): Terminated {rc=256} 11:42:06.727254 --- ParallelTerminationStrategy: PID 3434 died... 11:42:06.746675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3434): Terminated: ok {rc=0} 11:42:06.791976 --- ParallelTerminationStrategy: PID 3437 died... 11:42:06.811220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3437): Terminated: ok {rc=0} 11:42:06.856616 --- ParallelTerminationStrategy: PID 3440 died... 11:42:06.876290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3440): Terminated: ok {rc=0} 11:42:06.962886 bus /gobi_4: Setting Powered False 11:42:08.058511 bus /gobi_4: Setting Powered False 11:42:09.173515 bus /gobi_1: Setting Powered False 11:42:10.270665 bus /gobi_1: Setting Powered False 11:42:11.384697 bus /gobi_0: Setting Powered False 11:42:12.485655 bus /gobi_0: Setting Powered False 11:42:13.600860 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:42:14.703217 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:14.715446 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:42:14.769489 tst ping.py: using LAC 28149 11:42:14.894744 tst ping.py: using RAC 99 11:42:15.019882 tst ping.py: using CellId 28149 11:42:15.143788 tst ping.py: using BVCI 28150 11:42:15.259168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:15.270870 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:15.282407 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:15.293968 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:15.305369 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:15.316826 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:15.328433 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:15.339844 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:42:15.459692 tst ping.py:19: start network... 11:42:15.672489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:16.171207 run create_hlr_db(pid=3442): Launched 11:42:16.330237 bus /gobi_6: Setting Powered False 11:42:17.393894 run create_hlr_db(pid=3442): Terminated: ok {rc=0} 11:42:17.817146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3444): Launched 11:42:18.112367 run osmo-hlr_10.42.42.2(pid=3445): Launched 11:42:18.225485 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:18.749743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3447): Launched 11:42:19.044355 run osmo-stp_10.42.42.5(pid=3448): Launched 11:42:19.157363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:19.667740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3450): Launched 11:42:19.780331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:20.030250 run patchelf(pid=3451): Launched 11:42:20.194851 run osmo-stp_10.42.42.5(pid=3448): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3448)] 11:42:20.319808 run osmo-stp_10.42.42.5(pid=3448): stdout: | (launched: 2022-12-10_11:42:18.990540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:20.446512 run osmo-stp_10.42.42.5(pid=3448): stderr: | 20221210114219161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114219161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114219162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114219162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114219162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114219163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114219163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:20.573440 run osmo-stp_10.42.42.5(pid=3448): stdout: | (launched: 2022-12-10_11:42:18.990540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:20.694909 run osmo-stp_10.42.42.5(pid=3448): stderr: | 20221210114219161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114219161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114219162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114219162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114219162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114219163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114219163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:20.838562 run patchelf(pid=3451): Terminating (SIGINT) 11:42:21.004556 run patchelf(pid=3451): Terminated: ok {rc=0} 11:42:21.124936 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3448): Process ended prematurely: osmo-stp_10.42.42.5(pid=3448) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3448)] [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:42:21.134095 tst ping.py:22: Test FAILED (6.4 sec) 11:42:21.161044 run osmo-hlr_10.42.42.2(pid=3445): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3445)] 11:42:21.208728 run osmo-hlr_10.42.42.2(pid=3445): stdout: | (launched: 2022-12-10_11:42:18.058466) 11:42:21.258207 run osmo-hlr_10.42.42.2(pid=3445): stderr: | 20221210114218237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114218237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114218237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114218237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114218237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114218237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114218249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114218257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114218257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114218257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:21.307725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3444): Terminating (SIGTERM) 11:42:21.347345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3447): Terminating (SIGTERM) 11:42:21.387002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3450): Terminating (SIGTERM) 11:42:21.426934 --- ParallelTerminationStrategy: PID 3444 died... 11:42:21.445914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3444): Terminated: ok {rc=0} 11:42:21.490207 --- ParallelTerminationStrategy: PID 3447 died... 11:42:21.508739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3447): Terminated: ok {rc=0} 11:42:21.552814 --- ParallelTerminationStrategy: PID 3450 died... 11:42:21.571756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3450): Terminated: ok {rc=0} 11:42:21.657837 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:42:22.746196 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:22.758521 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:42:22.811409 tst ping_idle_ping.py: using LAC 28150 11:42:22.928209 tst ping_idle_ping.py: using RAC 100 11:42:23.044413 tst ping_idle_ping.py: using CellId 28150 11:42:23.161143 tst ping_idle_ping.py: using BVCI 28151 11:42:23.278133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:23.290106 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:23.301727 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:23.314058 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:23.325989 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:23.338159 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:23.350385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:42:23.362329 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:42:23.478566 tst ping_idle_ping.py:24: start network... 11:42:23.678657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:24.141699 run create_hlr_db(pid=3452): Launched 11:42:24.254819 bus /gobi_6: Setting Powered False 11:42:25.314977 run create_hlr_db(pid=3452): Terminated: ok {rc=0} 11:42:25.750145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3454): Launched 11:42:26.068533 run osmo-hlr_10.42.42.2(pid=3455): Launched 11:42:26.190664 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:26.737655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3457): Launched 11:42:27.054348 run osmo-stp_10.42.42.5(pid=3458): Launched 11:42:27.176094 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:27.724189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3460): Launched 11:42:27.845227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:28.112350 run patchelf(pid=3461): Launched 11:42:28.288430 run osmo-stp_10.42.42.5(pid=3458): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3458)] 11:42:28.422386 run osmo-stp_10.42.42.5(pid=3458): stdout: | (launched: 2022-12-10_11:42:26.996659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:28.558189 run osmo-stp_10.42.42.5(pid=3458): stderr: | 20221210114227187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114227187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114227187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114227187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114227190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114227190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114227190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:28.694100 run osmo-stp_10.42.42.5(pid=3458): stdout: | (launched: 2022-12-10_11:42:26.996659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:28.823850 run osmo-stp_10.42.42.5(pid=3458): stderr: | 20221210114227187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114227187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114227187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114227187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114227190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114227190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114227190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:28.978208 run patchelf(pid=3461): Terminating (SIGINT) 11:42:29.155039 run patchelf(pid=3461): Terminated: ok {rc=0} 11:42:29.282496 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3458): Process ended prematurely: osmo-stp_10.42.42.5(pid=3458) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3458)] [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:42:29.292118 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:42:29.320027 run osmo-hlr_10.42.42.2(pid=3455): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3455)] 11:42:29.369589 run osmo-hlr_10.42.42.2(pid=3455): stdout: | (launched: 2022-12-10_11:42:26.010544) 11:42:29.420884 run osmo-hlr_10.42.42.2(pid=3455): stderr: | 20221210114226209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114226209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114226209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114226209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114226209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114226209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114226225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114226234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114226234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114226234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:29.473102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3454): Terminating (SIGTERM) 11:42:29.514540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3457): Terminating (SIGTERM) 11:42:29.555970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3460): Terminating (SIGTERM) 11:42:29.597650 --- ParallelTerminationStrategy: PID 3454 died... 11:42:29.617483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3454): Terminated: ok {rc=0} 11:42:29.663221 --- ParallelTerminationStrategy: PID 3457 died... 11:42:29.682664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3457): Terminated: ok {rc=0} 11:42:29.728399 --- ParallelTerminationStrategy: PID 3460 died... 11:42:29.747947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3460): Terminated: ok {rc=0} 11:42:29.834090 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:42:31.192786 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:42:31.204005 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:42:31.243067 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:42:31.279312 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:42:31.333312 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:42:31.368317 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:42:31.404832 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:42:31.961835 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:42:31.967879 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:31.980064 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:42:32.052087 tst switch_tch_pdch.py: using LAC 28151 11:42:32.180509 tst switch_tch_pdch.py: using RAC 101 11:42:32.303749 tst switch_tch_pdch.py: using CellId 28151 11:42:32.421864 tst switch_tch_pdch.py: using BVCI 28152 11:42:32.529281 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:32.540589 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:32.551674 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:32.563488 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:32.575015 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:32.586956 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:32.598809 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:32.610265 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:42:32.728496 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:42:32.848627 tst switch_tch_pdch.py:51: start network... 11:42:33.061978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:33.553191 run create_hlr_db(pid=3465): Launched 11:42:33.682538 bus /gobi_6: Setting Powered False 11:42:34.746008 run create_hlr_db(pid=3465): Terminated: ok {rc=0} 11:42:35.171248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3467): Launched 11:42:35.490510 run osmo-hlr_10.42.42.2(pid=3468): Launched 11:42:35.612325 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:36.156724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3471): Launched 11:42:36.472716 run osmo-stp_10.42.42.5(pid=3472): Launched 11:42:36.594257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:37.140339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3474): Launched 11:42:37.261258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:37.529062 run patchelf(pid=3475): Launched 11:42:37.704684 run osmo-stp_10.42.42.5(pid=3472): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3472)] 11:42:37.838388 run osmo-stp_10.42.42.5(pid=3472): stdout: | (launched: 2022-12-10_11:42:36.414531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:37.973971 run osmo-stp_10.42.42.5(pid=3472): stderr: | 20221210114236606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114236606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114236607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114236607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114236607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114236608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114236608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:38.109148 run osmo-stp_10.42.42.5(pid=3472): stdout: | (launched: 2022-12-10_11:42:36.414531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:38.238420 run osmo-stp_10.42.42.5(pid=3472): stderr: | 20221210114236606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114236606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114236607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114236607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114236607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114236608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114236608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:38.391661 run patchelf(pid=3475): Terminating (SIGINT) 11:42:38.568465 run patchelf(pid=3475): Terminated: ok {rc=0} 11:42:38.695300 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3472): Process ended prematurely: osmo-stp_10.42.42.5(pid=3472) [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3472)] [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:42:38.704637 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:42:38.732350 run osmo-hlr_10.42.42.2(pid=3468): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3468)] 11:42:38.781885 run osmo-hlr_10.42.42.2(pid=3468): stdout: | (launched: 2022-12-10_11:42:35.432545) 11:42:38.833114 run osmo-hlr_10.42.42.2(pid=3468): stderr: | 20221210114235631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114235631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114235631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114235631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114235631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114235631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114235643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114235651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114235651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114235651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:38.884634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3467): Terminating (SIGTERM) 11:42:38.926341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3471): Terminating (SIGTERM) 11:42:38.968053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3474): Terminating (SIGTERM) 11:42:39.010002 --- ParallelTerminationStrategy: PID 3467 died... 11:42:39.029589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3467): Terminated: ok {rc=0} 11:42:39.075295 --- ParallelTerminationStrategy: PID 3471 died... 11:42:39.094732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3471): Terminated: ok {rc=0} 11:42:39.140321 --- ParallelTerminationStrategy: PID 3474 died... 11:42:39.159627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3474): Terminated: ok {rc=0} 11:42:39.246929 bus /gobi_0: Setting Powered False 11:42:40.345423 bus /gobi_0: Setting Powered False 11:42:41.459253 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:42:42.712276 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:42:42.718340 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:42:42.751871 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:42:42.786737 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:42:42.842582 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:42:42.876537 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:42:42.910420 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:42:43.466722 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:42:43.471938 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:43.483314 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:42:43.553287 tst switch_tch_pdch.py: using LAC 28152 11:42:43.676767 tst switch_tch_pdch.py: using RAC 102 11:42:43.800428 tst switch_tch_pdch.py: using CellId 28152 11:42:43.924403 tst switch_tch_pdch.py: using BVCI 28153 11:42:44.040551 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:44.051883 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:44.062985 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:44.074078 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:44.085220 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:44.096267 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:44.107478 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:42:44.118635 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:42:44.234315 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:42:44.351470 tst switch_tch_pdch.py:51: start network... 11:42:44.565100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:45.026495 run create_hlr_db(pid=3479): Launched 11:42:45.154729 bus /gobi_6: Setting Powered False 11:42:46.244343 run create_hlr_db(pid=3479): Terminated: ok {rc=0} 11:42:46.765710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3481): Launched 11:42:47.098195 run osmo-hlr_10.42.42.2(pid=3482): Launched 11:42:47.343518 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:47.858283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3484): Launched 11:42:48.174670 run osmo-stp_10.42.42.5(pid=3485): Launched 11:42:48.295419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:48.811930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3487): Launched 11:42:48.931943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:49.197252 run patchelf(pid=3488): Launched 11:42:49.371945 run osmo-stp_10.42.42.5(pid=3485): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3485)] 11:42:49.506183 run osmo-stp_10.42.42.5(pid=3485): stdout: | (launched: 2022-12-10_11:42:48.117321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:49.640896 run osmo-stp_10.42.42.5(pid=3485): stderr: | 20221210114248311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114248311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114248311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114248311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114248312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114248312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114248312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:49.775538 run osmo-stp_10.42.42.5(pid=3485): stdout: | (launched: 2022-12-10_11:42:48.117321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:49.904455 run osmo-stp_10.42.42.5(pid=3485): stderr: | 20221210114248311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114248311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114248311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114248311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114248312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114248312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114248312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:50.057780 run patchelf(pid=3488): Terminating (SIGINT) 11:42:50.233621 run patchelf(pid=3488): Terminated: ok {rc=0} 11:42:50.359911 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3485): Process ended prematurely: osmo-stp_10.42.42.5(pid=3485) [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3485)] [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:42:50.369337 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:42:50.396824 run osmo-hlr_10.42.42.2(pid=3482): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3482)] 11:42:50.446377 run osmo-hlr_10.42.42.2(pid=3482): stdout: | (launched: 2022-12-10_11:42:47.032420) 11:42:50.497787 run osmo-hlr_10.42.42.2(pid=3482): stderr: | 20221210114247262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114247262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114247262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114247263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114247263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114247263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114247276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114247285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114247285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114247286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:50.549397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3481): Terminating (SIGTERM) 11:42:50.590424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3484): Terminating (SIGTERM) 11:42:50.631673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3487): Terminating (SIGTERM) 11:42:50.673197 --- ParallelTerminationStrategy: PID 3481 died... 11:42:50.692854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3481): Terminated: ok {rc=0} 11:42:50.738483 --- ParallelTerminationStrategy: PID 3484 died... 11:42:50.757881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3484): Terminated: ok {rc=0} 11:42:50.803098 --- ParallelTerminationStrategy: PID 3487 died... 11:42:50.822325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3487): Terminated: ok {rc=0} 11:42:50.909030 bus /gobi_0: Setting Powered False 11:42:52.004532 bus /gobi_0: Setting Powered False 11:42:53.120861 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 11:42:54.375916 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:42:54.380066 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:42:54.413949 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 11:42:54.420805 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:42:54.473472 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:42:54.507511 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 11:42:54.514479 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:42:55.053605 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 11:42:55.059694 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 11:42:55.071002 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:42:55.121442 tst mo_mt_sms.py: using LAC 28153 11:42:55.250082 tst mo_mt_sms.py: using RAC 103 11:42:55.369365 tst mo_mt_sms.py: using CellId 28153 11:42:55.483044 tst mo_mt_sms.py: using BVCI 28154 11:42:55.590073 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:42:55.700851 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:42:55.815372 tst mo_mt_sms.py:9: start nitb and bts... 11:42:56.029621 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:42:56.674082 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3492): Launched 11:42:56.989292 run osmo-nitb_10.42.42.2(pid=3493): Launched 11:42:57.164773 run osmo-nitb_10.42.42.2(pid=3493): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3493)] 11:42:57.305993 run osmo-nitb_10.42.42.2(pid=3493): stdout: | (launched: 2022-12-10_11:42:56.931872) 11:42:57.448917 run osmo-nitb_10.42.42.2(pid=3493): stderr: | (launched: 2022-12-10_11:42:56.978790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:42:57.592442 run osmo-nitb_10.42.42.2(pid=3493): stdout: | (launched: 2022-12-10_11:42:56.931872) 11:42:57.729758 run osmo-nitb_10.42.42.2(pid=3493): stderr: | (launched: 2022-12-10_11:42:56.978790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3493): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3493) [trial-2374↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3493)] 11:42:58.109106 tst osmo-nitb_10.42.42.2(pid=3493): stdout: | (launched: 2022-12-10_11:42:56.931872) 11:42:58.237241 tst osmo-nitb_10.42.42.2(pid=3493): stderr: | (launched: 2022-12-10_11:42:56.978790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:42:58.388592 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3493): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3493) [trial-2374↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3493)] [trial-2374↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 11:42:58.397593 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:42:58.404590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3492): Terminating (SIGTERM) 11:42:58.617215 --- ParallelTerminationStrategy: PID 3492 died... 11:42:58.638341 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3492): Terminated: ok {rc=0} 11:42:58.726457 bus /sierra_3: Setting Powered False 11:42:59.827787 bus /sierra_3: Setting Powered False 11:43:00.960639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:trx-sysmocell5000 --------------------------------------------------------------------- 11:43:02.194884 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:02.199394 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:43:02.238123 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:43:02.265861 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:43:02.319454 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:43:02.353856 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:43:02.380883 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:43:02.927190 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 11:43:02.932228 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:02.943280 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:43:02.991890 tst mo_mt_sms.py: using LAC 28154 11:43:03.117449 tst mo_mt_sms.py: using RAC 104 11:43:03.245995 tst mo_mt_sms.py: using CellId 28154 11:43:03.369133 tst mo_mt_sms.py: using BVCI 28155 11:43:03.484147 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:03.495443 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:03.506437 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:03.517318 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:03.528130 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:03.538966 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:43:03.652079 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:43:03.765309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:04.225953 run create_hlr_db(pid=3497): Launched 11:43:04.339631 bus /sierra_2: Setting Powered False 11:43:05.398853 run create_hlr_db(pid=3497): Terminated: ok {rc=0} 11:43:05.833715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3499): Launched 11:43:06.150038 run osmo-hlr_10.42.42.2(pid=3500): Launched 11:43:06.271150 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:06.815349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3502): Launched 11:43:07.131367 run osmo-stp_10.42.42.5(pid=3503): Launched 11:43:07.251910 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:07.824130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3505): Launched 11:43:08.141148 run osmo-msc_10.42.42.6(pid=3506): Launched 11:43:08.318175 run osmo-stp_10.42.42.5(pid=3503): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3503)] 11:43:08.451840 run osmo-stp_10.42.42.5(pid=3503): stdout: | (launched: 2022-12-10_11:43:07.074125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:08.585622 run osmo-stp_10.42.42.5(pid=3503): stderr: | 20221210114307267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114307267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114307267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114307268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114307268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114307268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114307268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:08.721154 run osmo-stp_10.42.42.5(pid=3503): stdout: | (launched: 2022-12-10_11:43:07.074125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:08.847164 run osmo-stp_10.42.42.5(pid=3503): stderr: | 20221210114307267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114307267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114307267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114307268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114307268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114307268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114307268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:08.998251 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3503): Process ended prematurely: osmo-stp_10.42.42.5(pid=3503) [trial-2374↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3503)] [trial-2374↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 11:43:09.007055 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 11:43:09.034544 run osmo-hlr_10.42.42.2(pid=3500): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3500)] 11:43:09.084750 run osmo-hlr_10.42.42.2(pid=3500): stdout: | (launched: 2022-12-10_11:43:06.092643) 11:43:09.136378 run osmo-hlr_10.42.42.2(pid=3500): stderr: | 20221210114306290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114306290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114306290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114306290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114306290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114306290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114306303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114306311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114306311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114306311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:09.208192 run osmo-msc_10.42.42.6(pid=3506): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3506)] 11:43:09.258063 run osmo-msc_10.42.42.6(pid=3506): stdout: | (launched: 2022-12-10_11:43:08.083341) 11:43:09.309509 run osmo-msc_10.42.42.6(pid=3506): stderr: | 20221210114308405 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114308405 DLGLOBAL DEBUG validating counter group 0x7f53923f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114308405 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114308405 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114308405 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114308405 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114308407 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114308407 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114308408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114308408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:09.361883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3499): Terminating (SIGTERM) 11:43:09.403433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3502): Terminating (SIGTERM) 11:43:09.445502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3505): Terminating (SIGTERM) 11:43:09.487483 --- ParallelTerminationStrategy: PID 3499 died... 11:43:09.507535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3499): Terminated: ok {rc=0} 11:43:09.553725 --- ParallelTerminationStrategy: PID 3502 died... 11:43:09.573226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3502): Terminated: ok {rc=0} 11:43:09.619244 --- ParallelTerminationStrategy: PID 3505 died... 11:43:09.638974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3505): Terminated: ok {rc=0} 11:43:09.726315 bus /sierra_3: Setting Powered False 11:43:10.825373 bus /sierra_3: Setting Powered False 11:43:11.940060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 11:43:13.174976 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:13.179414 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:43:13.215010 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 11:43:13.221688 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 11:43:13.262334 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:43:13.296848 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 11:43:13.303499 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 11:43:13.817024 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 11:43:13.822047 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 11:43:13.833242 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:43:13.881152 tst assert_extension.py: using LAC 28155 11:43:13.999909 tst assert_extension.py: using RAC 105 11:43:14.113842 tst assert_extension.py: using CellId 28155 11:43:14.227817 tst assert_extension.py: using BVCI 28156 11:43:14.334173 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 11:43:14.447844 tst assert_extension.py:10: start nitb and bts... 11:43:14.645396 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:43:15.250722 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3512): Launched 11:43:15.545539 run osmo-nitb_10.42.42.2(pid=3513): Launched 11:43:15.710001 run osmo-nitb_10.42.42.2(pid=3513): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3513)] 11:43:15.856111 run osmo-nitb_10.42.42.2(pid=3513): stdout: | (launched: 2022-12-10_11:43:15.491566) 11:43:16.016495 run osmo-nitb_10.42.42.2(pid=3513): stderr: | (launched: 2022-12-10_11:43:15.535489) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:43:16.166544 run osmo-nitb_10.42.42.2(pid=3513): stdout: | (launched: 2022-12-10_11:43:15.491566) 11:43:16.309325 run osmo-nitb_10.42.42.2(pid=3513): stderr: | (launched: 2022-12-10_11:43:15.535489) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3513): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3513) [trial-2374↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3513)] 11:43:16.657225 tst osmo-nitb_10.42.42.2(pid=3513): stdout: | (launched: 2022-12-10_11:43:15.491566) 11:43:16.787009 tst osmo-nitb_10.42.42.2(pid=3513): stderr: | (launched: 2022-12-10_11:43:15.535489) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:43:16.942450 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3513): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3513) [trial-2374↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3513)] [trial-2374↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 11:43:16.952345 tst assert_extension.py:12: Test FAILED (3.1 sec) 11:43:16.960603 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3512): Terminating (SIGTERM) 11:43:17.173732 --- ParallelTerminationStrategy: PID 3512 died... 11:43:17.194248 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3512): Terminated: ok {rc=0} 11:43:17.282656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 11:43:18.462403 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:18.466442 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:43:18.501438 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:43:18.527620 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 11:43:18.563835 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:43:18.598748 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:43:18.625854 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 11:43:19.154865 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 11:43:19.160842 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:19.172104 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:43:19.219707 tst assert_extension.py: using LAC 28156 11:43:19.339833 tst assert_extension.py: using RAC 106 11:43:19.455150 tst assert_extension.py: using CellId 28156 11:43:19.569239 tst assert_extension.py: using BVCI 28157 11:43:19.675573 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:19.686238 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:19.696837 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:19.707340 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:19.717999 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:43:19.728267 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 11:43:19.844539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:20.336161 run create_hlr_db(pid=3517): Launched 11:43:20.467049 bus /sierra_2: Setting Powered False 11:43:21.530283 run create_hlr_db(pid=3517): Terminated: ok {rc=0} 11:43:21.953324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3519): Launched 11:43:22.249569 run osmo-hlr_10.42.42.2(pid=3520): Launched 11:43:22.363065 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:22.989675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3522): Launched 11:43:23.280558 run osmo-stp_10.42.42.5(pid=3523): Launched 11:43:23.392061 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:23.918172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3525): Launched 11:43:24.210391 run osmo-msc_10.42.42.6(pid=3526): Launched 11:43:24.373262 run osmo-stp_10.42.42.5(pid=3523): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3523)] 11:43:24.496852 run osmo-stp_10.42.42.5(pid=3523): stdout: | (launched: 2022-12-10_11:43:23.227299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:24.621713 run osmo-stp_10.42.42.5(pid=3523): stderr: | 20221210114323395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114323395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114323396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114323396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114323397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114323397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114323397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:24.743206 run osmo-stp_10.42.42.5(pid=3523): stdout: | (launched: 2022-12-10_11:43:23.227299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:24.859402 run osmo-stp_10.42.42.5(pid=3523): stderr: | 20221210114323395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114323395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114323396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114323396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114323397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114323397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114323397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:24.998601 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3523): Process ended prematurely: osmo-stp_10.42.42.5(pid=3523) [trial-2374↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3523)] [trial-2374↪ussd:trx-sysmocell5000↪assert_extension.py:17] 11:43:25.006742 tst assert_extension.py:17: Test FAILED (5.8 sec) 11:43:25.033090 run osmo-hlr_10.42.42.2(pid=3520): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3520)] 11:43:25.080591 run osmo-hlr_10.42.42.2(pid=3520): stdout: | (launched: 2022-12-10_11:43:22.195651) 11:43:25.129780 run osmo-hlr_10.42.42.2(pid=3520): stderr: | 20221210114322369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114322369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114322369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114322369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114322369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114322369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114322381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114322390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114322390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114322390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:25.197904 run osmo-msc_10.42.42.6(pid=3526): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3526)] 11:43:25.245187 run osmo-msc_10.42.42.6(pid=3526): stdout: | (launched: 2022-12-10_11:43:24.155826) 11:43:25.294220 run osmo-msc_10.42.42.6(pid=3526): stderr: | 20221210114324428 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114324428 DLGLOBAL DEBUG validating counter group 0x7f3e40925c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114324428 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114324428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114324428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114324428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114324430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114324431 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114324431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114324431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:25.343871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3519): Terminating (SIGTERM) 11:43:25.383513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3522): Terminating (SIGTERM) 11:43:25.423042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3525): Terminating (SIGTERM) 11:43:25.462860 --- ParallelTerminationStrategy: PID 3519 died... 11:43:25.481798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3519): Terminated: ok {rc=0} 11:43:25.525831 --- ParallelTerminationStrategy: PID 3522 died... 11:43:25.544049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3522): Terminated: ok {rc=0} 11:43:25.587748 --- ParallelTerminationStrategy: PID 3525 died... 11:43:25.606182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3525): Terminated: ok {rc=0} 11:43:25.690657 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:43:26.902530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:26.909254 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:43:26.943186 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:43:26.969333 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:43:27.021009 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:43:27.055829 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:43:27.083336 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:43:27.630794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:43:27.680649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:27.691872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:43:27.763989 tst mo_mt_call.py: using LAC 28157 11:43:27.884631 tst mo_mt_call.py: using RAC 107 11:43:28.002122 tst mo_mt_call.py: using CellId 28157 11:43:28.119651 tst mo_mt_call.py: using BVCI 28158 11:43:28.227544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:28.238611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:28.249477 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:28.260602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:28.271827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:28.283013 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:28.400037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:28.515420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:28.978540 run create_hlr_db(pid=3531): Launched 11:43:29.092618 bus /sierra_2: Setting Powered False 11:43:30.152691 run create_hlr_db(pid=3531): Terminated: ok {rc=0} 11:43:30.589728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3533): Launched 11:43:30.942711 run osmo-hlr_10.42.42.2(pid=3534): Launched 11:43:31.182602 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:31.891723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3536): Launched 11:43:32.236562 run osmo-stp_10.42.42.5(pid=3537): Launched 11:43:32.390716 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:32.931096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3540): Launched 11:43:33.229674 run osmo-msc_10.42.42.6(pid=3541): Launched 11:43:33.397526 run osmo-stp_10.42.42.5(pid=3537): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3537)] 11:43:33.524009 run osmo-stp_10.42.42.5(pid=3537): stdout: | (launched: 2022-12-10_11:43:32.163761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:33.651177 run osmo-stp_10.42.42.5(pid=3537): stderr: | 20221210114332426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114332426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114332426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114332426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114332427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114332427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114332427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:33.775346 run osmo-stp_10.42.42.5(pid=3537): stdout: | (launched: 2022-12-10_11:43:32.163761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:33.894923 run osmo-stp_10.42.42.5(pid=3537): stderr: | 20221210114332426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114332426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114332426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114332426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114332427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114332427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114332427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:34.037604 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3537): Process ended prematurely: osmo-stp_10.42.42.5(pid=3537) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3537)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:43:34.046800 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:43:34.073345 run osmo-hlr_10.42.42.2(pid=3534): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3534)] 11:43:34.121360 run osmo-hlr_10.42.42.2(pid=3534): stdout: | (launched: 2022-12-10_11:43:30.864188) 11:43:34.170879 run osmo-hlr_10.42.42.2(pid=3534): stderr: | 20221210114331093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114331093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114331094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114331094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114331094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114331094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114331128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114331137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114331137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114331137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:34.240023 run osmo-msc_10.42.42.6(pid=3541): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3541)] 11:43:34.288186 run osmo-msc_10.42.42.6(pid=3541): stdout: | (launched: 2022-12-10_11:43:33.175161) 11:43:34.337744 run osmo-msc_10.42.42.6(pid=3541): stderr: | 20221210114333446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114333446 DLGLOBAL DEBUG validating counter group 0x7fce7fdb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114333446 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114333446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114333446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114333447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114333449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114333449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114333449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114333449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:34.387712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3533): Terminating (SIGTERM) 11:43:34.427578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3536): Terminating (SIGTERM) 11:43:34.467551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3540): Terminating (SIGTERM) 11:43:34.507880 --- ParallelTerminationStrategy: PID 3533 died... 11:43:34.526779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3533): Terminated: ok {rc=0} 11:43:34.571039 --- ParallelTerminationStrategy: PID 3536 died... 11:43:34.589432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3536): Terminated: ok {rc=0} 11:43:34.634240 --- ParallelTerminationStrategy: PID 3540 died... 11:43:34.652708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3540): Terminated: ok {rc=0} 11:43:34.737288 bus /sierra_3: Setting Powered False 11:43:35.835940 bus /sierra_3: Setting Powered False 11:43:36.955709 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:43:38.103094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:38.114784 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:43:38.184355 tst mo_mt_call_osmux.py: using LAC 28158 11:43:38.301286 tst mo_mt_call_osmux.py: using RAC 108 11:43:38.418578 tst mo_mt_call_osmux.py: using CellId 28158 11:43:38.535805 tst mo_mt_call_osmux.py: using BVCI 28159 11:43:38.645197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:38.656319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:38.667336 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:38.678598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:38.690229 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:38.701726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:38.819012 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:38.937275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:39.430237 run create_hlr_db(pid=3543): Launched 11:43:39.560849 bus /sierra_2: Setting Powered False 11:43:40.624797 run create_hlr_db(pid=3543): Terminated: ok {rc=0} 11:43:41.052350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Launched 11:43:41.351362 run osmo-hlr_10.42.42.2(pid=3546): Launched 11:43:41.465113 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:41.992177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Launched 11:43:42.291077 run osmo-stp_10.42.42.5(pid=3549): Launched 11:43:42.406021 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:42.945823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Launched 11:43:43.250426 run osmo-msc_10.42.42.6(pid=3552): Launched 11:43:43.417145 run osmo-stp_10.42.42.5(pid=3549): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] 11:43:43.542907 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-10_11:43:42.236931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:43.668864 run osmo-stp_10.42.42.5(pid=3549): stderr: | 20221210114342405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114342405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114342406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114342406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114342406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114342406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114342407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:43.792683 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-10_11:43:42.236931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:43.911657 run osmo-stp_10.42.42.5(pid=3549): stderr: | 20221210114342405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114342405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114342406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114342406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114342406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114342406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114342407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:44.053580 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:43:44.062376 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:43:44.088719 run osmo-hlr_10.42.42.2(pid=3546): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3546)] 11:43:44.136435 run osmo-hlr_10.42.42.2(pid=3546): stdout: | (launched: 2022-12-10_11:43:41.296914) 11:43:44.185615 run osmo-hlr_10.42.42.2(pid=3546): stderr: | 20221210114341473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114341474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114341474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114341474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114341474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114341474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114341486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114341495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114341495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114341495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:44.254225 run osmo-msc_10.42.42.6(pid=3552): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3552)] 11:43:44.301563 run osmo-msc_10.42.42.6(pid=3552): stdout: | (launched: 2022-12-10_11:43:43.196280) 11:43:44.350493 run osmo-msc_10.42.42.6(pid=3552): stderr: | 20221210114343465 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114343465 DLGLOBAL DEBUG validating counter group 0x7f8cad3d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114343465 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114343465 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114343466 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114343466 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114343468 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114343468 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114343469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114343469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:44.399846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminating (SIGTERM) 11:43:44.439166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminating (SIGTERM) 11:43:44.478313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminating (SIGTERM) 11:43:44.517835 --- ParallelTerminationStrategy: PID 3545 died... 11:43:44.536588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminated: ok {rc=0} 11:43:44.580546 --- ParallelTerminationStrategy: PID 3548 died... 11:43:44.598782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminated: ok {rc=0} 11:43:44.642420 --- ParallelTerminationStrategy: PID 3551 died... 11:43:44.660658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminated: ok {rc=0} 11:43:44.743392 bus /sierra_3: Setting Powered False 11:43:45.843417 bus /sierra_3: Setting Powered False 11:43:46.978641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:43:48.234362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:48.242618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:43:48.276760 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:43:48.303762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:43:48.357582 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:43:48.392687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:43:48.419256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:43:48.966108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:43:49.014867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:49.026178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:43:49.095180 tst mo_mt_call.py: using LAC 28159 11:43:49.216468 tst mo_mt_call.py: using RAC 109 11:43:49.334571 tst mo_mt_call.py: using CellId 28159 11:43:49.452159 tst mo_mt_call.py: using BVCI 28160 11:43:49.569207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:49.581139 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:49.592527 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:49.603983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:49.615465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:49.626779 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:43:49.746516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:43:49.861189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:50.322663 run create_hlr_db(pid=3557): Launched 11:43:50.437457 bus /sierra_2: Setting Powered False 11:43:51.497624 run create_hlr_db(pid=3557): Terminated: ok {rc=0} 11:43:51.912658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3559): Launched 11:43:52.211232 run osmo-hlr_10.42.42.2(pid=3560): Launched 11:43:52.325963 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:52.836403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3562): Launched 11:43:53.134185 run osmo-stp_10.42.42.5(pid=3563): Launched 11:43:53.248284 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:53.791138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3565): Launched 11:43:54.089918 run osmo-msc_10.42.42.6(pid=3566): Launched 11:43:54.257982 run osmo-stp_10.42.42.5(pid=3563): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3563)] 11:43:54.385262 run osmo-stp_10.42.42.5(pid=3563): stdout: | (launched: 2022-12-10_11:43:53.079760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:54.512126 run osmo-stp_10.42.42.5(pid=3563): stderr: | 20221210114353253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114353253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114353253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114353254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114353254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114353254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114353254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:54.636639 run osmo-stp_10.42.42.5(pid=3563): stdout: | (launched: 2022-12-10_11:43:53.079760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:54.755982 run osmo-stp_10.42.42.5(pid=3563): stderr: | 20221210114353253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114353253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114353253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114353254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114353254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114353254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114353254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:54.898930 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3563): Process ended prematurely: osmo-stp_10.42.42.5(pid=3563) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3563)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:43:54.907819 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 11:43:54.934861 run osmo-hlr_10.42.42.2(pid=3560): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3560)] 11:43:54.983038 run osmo-hlr_10.42.42.2(pid=3560): stdout: | (launched: 2022-12-10_11:43:52.156623) 11:43:55.032639 run osmo-hlr_10.42.42.2(pid=3560): stderr: | 20221210114352332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114352332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114352332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114352332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114352332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114352332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114352360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114352370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114352370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114352370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:55.101810 run osmo-msc_10.42.42.6(pid=3566): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3566)] 11:43:55.149904 run osmo-msc_10.42.42.6(pid=3566): stdout: | (launched: 2022-12-10_11:43:54.035505) 11:43:55.199375 run osmo-msc_10.42.42.6(pid=3566): stderr: | 20221210114354306 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114354306 DLGLOBAL DEBUG validating counter group 0x7f6986001c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114354306 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114354306 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114354306 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114354307 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114354308 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114354309 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114354309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114354309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:55.249407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3559): Terminating (SIGTERM) 11:43:55.289170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3562): Terminating (SIGTERM) 11:43:55.329051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3565): Terminating (SIGTERM) 11:43:55.369190 --- ParallelTerminationStrategy: PID 3559 died... 11:43:55.388068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3559): Terminated: ok {rc=0} 11:43:55.432815 --- ParallelTerminationStrategy: PID 3562 died... 11:43:55.451488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3562): Terminated: ok {rc=0} 11:43:55.495611 --- ParallelTerminationStrategy: PID 3565 died... 11:43:55.514297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3565): Terminated: ok {rc=0} 11:43:55.600365 bus /sierra_3: Setting Powered False 11:43:56.699818 bus /sierra_3: Setting Powered False 11:43:57.815409 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:43:58.959783 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:58.971745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:43:59.040923 tst mo_mt_call_osmux.py: using LAC 28160 11:43:59.158232 tst mo_mt_call_osmux.py: using RAC 110 11:43:59.274844 tst mo_mt_call_osmux.py: using CellId 28160 11:43:59.394130 tst mo_mt_call_osmux.py: using BVCI 28161 11:43:59.511613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:59.523656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:59.535145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:59.547188 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:59.559350 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:43:59.571330 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:43:59.687639 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:43:59.799766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:00.262183 run create_hlr_db(pid=3568): Launched 11:44:00.376666 bus /sierra_2: Setting Powered False 11:44:01.452924 run create_hlr_db(pid=3568): Terminated: ok {rc=0} 11:44:01.883581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Launched 11:44:02.261753 run osmo-hlr_10.42.42.2(pid=3571): Launched 11:44:02.391684 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:02.916266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Launched 11:44:03.213295 run osmo-stp_10.42.42.5(pid=3574): Launched 11:44:03.326704 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:03.864206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Launched 11:44:04.163411 run osmo-msc_10.42.42.6(pid=3577): Launched 11:44:04.330417 run osmo-stp_10.42.42.5(pid=3574): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] 11:44:04.456495 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-10_11:44:03.159376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:04.582941 run osmo-stp_10.42.42.5(pid=3574): stderr: | 20221210114403329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114403329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114403329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114403330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114403332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114403332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114403332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:04.706789 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-10_11:44:03.159376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:04.825849 run osmo-stp_10.42.42.5(pid=3574): stderr: | 20221210114403329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114403329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114403329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114403330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114403332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114403332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114403332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:04.968023 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:44:04.977134 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:44:05.003278 run osmo-hlr_10.42.42.2(pid=3571): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3571)] 11:44:05.050219 run osmo-hlr_10.42.42.2(pid=3571): stdout: | (launched: 2022-12-10_11:44:02.193207) 11:44:05.099025 run osmo-hlr_10.42.42.2(pid=3571): stderr: | 20221210114402391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114402391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114402391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114402391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114402391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114402391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114402403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114402411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114402411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114402411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:05.166843 run osmo-msc_10.42.42.6(pid=3577): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3577)] 11:44:05.213904 run osmo-msc_10.42.42.6(pid=3577): stdout: | (launched: 2022-12-10_11:44:04.108841) 11:44:05.262150 run osmo-msc_10.42.42.6(pid=3577): stderr: | 20221210114404384 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114404384 DLGLOBAL DEBUG validating counter group 0x7fb3e0aa9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114404384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114404384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114404384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114404385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114404386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114404387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114404387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114404387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:05.311196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminating (SIGTERM) 11:44:05.350455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminating (SIGTERM) 11:44:05.389832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminating (SIGTERM) 11:44:05.429310 --- ParallelTerminationStrategy: PID 3570 died... 11:44:05.447963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminated: ok {rc=0} 11:44:05.491652 --- ParallelTerminationStrategy: PID 3573 died... 11:44:05.509928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminated: ok {rc=0} 11:44:05.553459 --- ParallelTerminationStrategy: PID 3576 died... 11:44:05.571812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminated: ok {rc=0} 11:44:05.657582 bus /sierra_3: Setting Powered False 11:44:06.755659 bus /sierra_3: Setting Powered False 11:44:07.870539 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:44:09.128236 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:09.135297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:44:09.169489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:44:09.196561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:44:09.249547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:44:09.282704 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:44:09.308691 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:44:09.862869 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:44:09.914747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:09.926583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:44:10.000290 tst mo_mt_call.py: using LAC 28161 11:44:10.126153 tst mo_mt_call.py: using RAC 111 11:44:10.249563 tst mo_mt_call.py: using CellId 28161 11:44:10.373088 tst mo_mt_call.py: using BVCI 28162 11:44:10.489292 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:10.501115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:10.512446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:10.523920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:10.535498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:10.546887 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:10.662734 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:10.779917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:11.275929 run create_hlr_db(pid=3582): Launched 11:44:11.405366 bus /sierra_2: Setting Powered False 11:44:12.468891 run create_hlr_db(pid=3582): Terminated: ok {rc=0} 11:44:12.895907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Launched 11:44:13.196534 run osmo-hlr_10.42.42.2(pid=3585): Launched 11:44:13.309674 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:13.834571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Launched 11:44:14.133522 run osmo-stp_10.42.42.5(pid=3588): Launched 11:44:14.247932 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:14.786484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3590): Launched 11:44:15.084239 run osmo-msc_10.42.42.6(pid=3591): Launched 11:44:15.253652 run osmo-stp_10.42.42.5(pid=3588): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] 11:44:15.380601 run osmo-stp_10.42.42.5(pid=3588): stdout: | (launched: 2022-12-10_11:44:14.078286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:15.507518 run osmo-stp_10.42.42.5(pid=3588): stderr: | 20221210114414250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114414251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114414251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114414251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114414252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114414252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114414252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:15.631793 run osmo-stp_10.42.42.5(pid=3588): stdout: | (launched: 2022-12-10_11:44:14.078286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:15.751427 run osmo-stp_10.42.42.5(pid=3588): stderr: | 20221210114414250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114414251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114414251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114414251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114414252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114414252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114414252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:15.925730 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3588): Process ended prematurely: osmo-stp_10.42.42.5(pid=3588) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:44:15.935162 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:44:15.963505 run osmo-hlr_10.42.42.2(pid=3585): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3585)] 11:44:16.014036 run osmo-hlr_10.42.42.2(pid=3585): stdout: | (launched: 2022-12-10_11:44:13.140760) 11:44:16.068790 run osmo-hlr_10.42.42.2(pid=3585): stderr: | 20221210114413317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114413317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114413317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114413317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114413317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114413317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114413329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114413338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114413338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114413338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:16.144181 run osmo-msc_10.42.42.6(pid=3591): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3591)] 11:44:16.195817 run osmo-msc_10.42.42.6(pid=3591): stdout: | (launched: 2022-12-10_11:44:15.029679) 11:44:16.250332 run osmo-msc_10.42.42.6(pid=3591): stderr: | 20221210114415301 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114415302 DLGLOBAL DEBUG validating counter group 0x7f6e22c9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114415302 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114415302 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114415302 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114415302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114415306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114415307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114415307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114415307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:16.303694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Terminating (SIGTERM) 11:44:16.347563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Terminating (SIGTERM) 11:44:16.393564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3590): Terminating (SIGTERM) 11:44:16.438885 --- ParallelTerminationStrategy: PID 3584 died... 11:44:16.460744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Terminated: ok {rc=0} 11:44:16.509764 --- ParallelTerminationStrategy: PID 3587 died... 11:44:16.530097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Terminated: ok {rc=0} 11:44:16.578081 --- ParallelTerminationStrategy: PID 3590 died... 11:44:16.598670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3590): Terminated: ok {rc=0} 11:44:16.689133 bus /sierra_3: Setting Powered False 11:44:17.787014 bus /sierra_3: Setting Powered False 11:44:18.902282 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:44:20.048720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:20.060695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:44:20.129876 tst mo_mt_call_osmux.py: using LAC 28162 11:44:20.246613 tst mo_mt_call_osmux.py: using RAC 112 11:44:20.364233 tst mo_mt_call_osmux.py: using CellId 28162 11:44:20.481458 tst mo_mt_call_osmux.py: using BVCI 28163 11:44:20.591997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:20.603206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:20.614146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:20.625371 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:20.636545 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:20.647674 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:20.762741 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:20.877125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:21.340490 run create_hlr_db(pid=3593): Launched 11:44:21.454314 bus /sierra_2: Setting Powered False 11:44:22.514864 run create_hlr_db(pid=3593): Terminated: ok {rc=0} 11:44:22.952204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3595): Launched 11:44:23.272295 run osmo-hlr_10.42.42.2(pid=3596): Launched 11:44:23.394922 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:23.944033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Launched 11:44:24.264360 run osmo-stp_10.42.42.5(pid=3599): Launched 11:44:24.386487 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:24.963577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3601): Launched 11:44:25.282855 run osmo-msc_10.42.42.6(pid=3602): Launched 11:44:25.463307 run osmo-stp_10.42.42.5(pid=3599): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3599)] 11:44:25.599528 run osmo-stp_10.42.42.5(pid=3599): stdout: | (launched: 2022-12-10_11:44:24.206097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:25.735176 run osmo-stp_10.42.42.5(pid=3599): stderr: | 20221210114424399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114424399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114424399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114424400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114424400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114424400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114424400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:25.869625 run osmo-stp_10.42.42.5(pid=3599): stdout: | (launched: 2022-12-10_11:44:24.206097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:25.997645 run osmo-stp_10.42.42.5(pid=3599): stderr: | 20221210114424399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114424399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114424399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114424400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114424400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114424400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114424400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:26.150965 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3599): Process ended prematurely: osmo-stp_10.42.42.5(pid=3599) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3599)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:44:26.160541 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:44:26.188299 run osmo-hlr_10.42.42.2(pid=3596): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3596)] 11:44:26.238715 run osmo-hlr_10.42.42.2(pid=3596): stdout: | (launched: 2022-12-10_11:44:23.214299) 11:44:26.290891 run osmo-hlr_10.42.42.2(pid=3596): stderr: | 20221210114423411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114423411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114423411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114423411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114423411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114423411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114423423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114423431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114423432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114423432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:26.362874 run osmo-msc_10.42.42.6(pid=3602): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3602)] 11:44:26.412557 run osmo-msc_10.42.42.6(pid=3602): stdout: | (launched: 2022-12-10_11:44:25.224566) 11:44:26.463915 run osmo-msc_10.42.42.6(pid=3602): stderr: | 20221210114425547 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114425547 DLGLOBAL DEBUG validating counter group 0x7f910cedfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114425548 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114425548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114425548 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114425548 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114425550 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114425550 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114425550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114425550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:26.516061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3595): Terminating (SIGTERM) 11:44:26.557554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Terminating (SIGTERM) 11:44:26.599059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3601): Terminating (SIGTERM) 11:44:26.640755 --- ParallelTerminationStrategy: PID 3595 died... 11:44:26.660622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3595): Terminated: ok {rc=0} 11:44:26.706439 --- ParallelTerminationStrategy: PID 3598 died... 11:44:26.725861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Terminated: ok {rc=0} 11:44:26.771403 --- ParallelTerminationStrategy: PID 3601 died... 11:44:26.790847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3601): Terminated: ok {rc=0} 11:44:26.877509 bus /sierra_3: Setting Powered False 11:44:27.975765 bus /sierra_3: Setting Powered False 11:44:29.091835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:44:30.340380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:30.346719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:44:30.380790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:44:30.407210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:44:30.459455 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:44:30.492605 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:44:30.518604 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:44:31.079326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:44:31.148534 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:31.164282 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:44:31.252184 tst mo_mt_call.py: using LAC 28163 11:44:31.373237 tst mo_mt_call.py: using RAC 113 11:44:31.538230 tst mo_mt_call.py: using CellId 28163 11:44:31.669523 tst mo_mt_call.py: using BVCI 28164 11:44:31.815325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:31.827666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:31.839873 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:31.852353 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:31.864632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:31.876851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:44:32.015734 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:44:32.150218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:32.635449 run create_hlr_db(pid=3608): Launched 11:44:32.750664 bus /sierra_2: Setting Powered False 11:44:33.810474 run create_hlr_db(pid=3608): Terminated: ok {rc=0} 11:44:34.247643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3610): Launched 11:44:34.568289 run osmo-hlr_10.42.42.2(pid=3611): Launched 11:44:34.690414 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:35.242747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3613): Launched 11:44:35.561484 run osmo-stp_10.42.42.5(pid=3614): Launched 11:44:35.685185 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:36.263971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3616): Launched 11:44:36.585475 run osmo-msc_10.42.42.6(pid=3617): Launched 11:44:36.762927 run osmo-stp_10.42.42.5(pid=3614): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3614)] 11:44:36.897361 run osmo-stp_10.42.42.5(pid=3614): stdout: | (launched: 2022-12-10_11:44:35.503730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:37.032106 run osmo-stp_10.42.42.5(pid=3614): stderr: | 20221210114435697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114435697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114435697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114435698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114435698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114435698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114435698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:37.166314 run osmo-stp_10.42.42.5(pid=3614): stdout: | (launched: 2022-12-10_11:44:35.503730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:37.293822 run osmo-stp_10.42.42.5(pid=3614): stderr: | 20221210114435697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114435697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114435697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114435698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114435698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114435698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114435698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:37.446136 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3614): Process ended prematurely: osmo-stp_10.42.42.5(pid=3614) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3614)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:44:37.455768 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:44:37.483362 run osmo-hlr_10.42.42.2(pid=3611): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3611)] 11:44:37.533263 run osmo-hlr_10.42.42.2(pid=3611): stdout: | (launched: 2022-12-10_11:44:34.510328) 11:44:37.584445 run osmo-hlr_10.42.42.2(pid=3611): stderr: | 20221210114434708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114434708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114434708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114434708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114434708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114434708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114434721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114434729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114434729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114434729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:37.655760 run osmo-msc_10.42.42.6(pid=3617): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3617)] 11:44:37.705221 run osmo-msc_10.42.42.6(pid=3617): stdout: | (launched: 2022-12-10_11:44:36.526792) 11:44:37.756157 run osmo-msc_10.42.42.6(pid=3617): stderr: | 20221210114436851 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114436851 DLGLOBAL DEBUG validating counter group 0x7f3adae8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114436851 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114436851 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114436852 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114436852 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114436853 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114436854 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114436854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114436854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:37.807347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3610): Terminating (SIGTERM) 11:44:37.848740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3613): Terminating (SIGTERM) 11:44:37.890200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3616): Terminating (SIGTERM) 11:44:37.932014 --- ParallelTerminationStrategy: PID 3610 died... 11:44:37.951801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3610): Terminated: ok {rc=0} 11:44:37.997699 --- ParallelTerminationStrategy: PID 3613 died... 11:44:38.017135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3613): Terminated: ok {rc=0} 11:44:38.062763 --- ParallelTerminationStrategy: PID 3616 died... 11:44:38.082214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3616): Terminated: ok {rc=0} 11:44:38.169214 bus /sierra_3: Setting Powered False 11:44:39.266340 bus /sierra_3: Setting Powered False 11:44:40.381886 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:44:41.529785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:41.542118 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:44:41.617608 tst mo_mt_call_osmux.py: using LAC 28164 11:44:41.742271 tst mo_mt_call_osmux.py: using RAC 114 11:44:41.866294 tst mo_mt_call_osmux.py: using CellId 28164 11:44:41.989960 tst mo_mt_call_osmux.py: using BVCI 28165 11:44:42.105886 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:42.117501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:42.128717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:42.140212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:42.151532 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:42.163275 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:44:42.277941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:44:42.396535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:42.864679 run create_hlr_db(pid=3619): Launched 11:44:42.979800 bus /sierra_2: Setting Powered False 11:44:44.040499 run create_hlr_db(pid=3619): Terminated: ok {rc=0} 11:44:44.478229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3621): Launched 11:44:44.798415 run osmo-hlr_10.42.42.2(pid=3622): Launched 11:44:44.920475 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:45.473092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3624): Launched 11:44:45.792885 run osmo-stp_10.42.42.5(pid=3625): Launched 11:44:46.020357 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:46.654770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3627): Launched 11:44:46.979835 run osmo-msc_10.42.42.6(pid=3628): Launched 11:44:47.294235 run osmo-stp_10.42.42.5(pid=3625): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3625)] 11:44:47.426910 run osmo-stp_10.42.42.5(pid=3625): stdout: | (launched: 2022-12-10_11:44:45.735124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:47.557859 run osmo-stp_10.42.42.5(pid=3625): stderr: | 20221210114445953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114445953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114445954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114445954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114445956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114445961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114445961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:47.683103 run osmo-stp_10.42.42.5(pid=3625): stdout: | (launched: 2022-12-10_11:44:45.735124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:47.802848 run osmo-stp_10.42.42.5(pid=3625): stderr: | 20221210114445953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114445953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114445954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114445954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114445956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114445961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114445961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:47.946045 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3625): Process ended prematurely: osmo-stp_10.42.42.5(pid=3625) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3625)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:44:47.955093 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:44:47.982265 run osmo-hlr_10.42.42.2(pid=3622): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3622)] 11:44:48.030023 run osmo-hlr_10.42.42.2(pid=3622): stdout: | (launched: 2022-12-10_11:44:44.740418) 11:44:48.079311 run osmo-hlr_10.42.42.2(pid=3622): stderr: | 20221210114444938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114444938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114444938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114444938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114444938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114444938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114444950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114444959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114444959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114444959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:48.148540 run osmo-msc_10.42.42.6(pid=3628): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3628)] 11:44:48.196101 run osmo-msc_10.42.42.6(pid=3628): stdout: | (launched: 2022-12-10_11:44:46.914007) 11:44:48.245379 run osmo-msc_10.42.42.6(pid=3628): stderr: | 20221210114447380 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114447380 DLGLOBAL DEBUG validating counter group 0x7ff2a6756c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114447380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114447380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114447380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114447381 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114447382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114447383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114447383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114447383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:48.295250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3621): Terminating (SIGTERM) 11:44:48.334667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3624): Terminating (SIGTERM) 11:44:48.374548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3627): Terminating (SIGTERM) 11:44:48.414693 --- ParallelTerminationStrategy: PID 3621 died... 11:44:48.433667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3621): Terminated: ok {rc=0} 11:44:48.478141 --- ParallelTerminationStrategy: PID 3624 died... 11:44:48.496617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3624): Terminated: ok {rc=0} 11:44:48.540768 --- ParallelTerminationStrategy: PID 3627 died... 11:44:48.559392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3627): Terminated: ok {rc=0} 11:44:48.643270 bus /sierra_3: Setting Powered False 11:44:49.740784 bus /sierra_3: Setting Powered False 11:44:50.859983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:44:52.105620 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:52.113850 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:44:52.147939 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:44:52.175120 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:44:52.226167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:44:52.260458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:44:52.287551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:44:52.843051 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:44:52.894204 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:44:52.905760 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:44:52.975742 tst mo_mt_call.py: using LAC 28165 11:44:53.100876 tst mo_mt_call.py: using RAC 115 11:44:53.223657 tst mo_mt_call.py: using CellId 28165 11:44:53.348292 tst mo_mt_call.py: using BVCI 28166 11:44:53.457272 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:44:53.468415 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:44:53.479646 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:44:53.491036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:44:53.502388 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:44:53.513690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:44:53.630274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:44:53.744550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:54.204907 run create_hlr_db(pid=3633): Launched 11:44:54.319269 bus /sierra_2: Setting Powered False 11:44:55.379119 run create_hlr_db(pid=3633): Terminated: ok {rc=0} 11:44:55.815701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3635): Launched 11:44:56.134640 run osmo-hlr_10.42.42.2(pid=3636): Launched 11:44:56.256403 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:56.809740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3638): Launched 11:44:57.127796 run osmo-stp_10.42.42.5(pid=3639): Launched 11:44:57.248997 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:57.825855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3641): Launched 11:44:58.144316 run osmo-msc_10.42.42.6(pid=3642): Launched 11:44:58.322308 run osmo-stp_10.42.42.5(pid=3639): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3639)] 11:44:58.456865 run osmo-stp_10.42.42.5(pid=3639): stdout: | (launched: 2022-12-10_11:44:57.070338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:58.593234 run osmo-stp_10.42.42.5(pid=3639): stderr: | 20221210114457261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114457261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114457261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114457262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114457262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114457262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114457262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:58.727328 run osmo-stp_10.42.42.5(pid=3639): stdout: | (launched: 2022-12-10_11:44:57.070338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:58.854505 run osmo-stp_10.42.42.5(pid=3639): stderr: | 20221210114457261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114457261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114457261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114457262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114457262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114457262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114457262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:59.006906 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3639): Process ended prematurely: osmo-stp_10.42.42.5(pid=3639) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3639)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:44:59.016264 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:44:59.043860 run osmo-hlr_10.42.42.2(pid=3636): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3636)] 11:44:59.093254 run osmo-hlr_10.42.42.2(pid=3636): stdout: | (launched: 2022-12-10_11:44:56.076135) 11:44:59.144225 run osmo-hlr_10.42.42.2(pid=3636): stderr: | 20221210114456278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114456278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114456278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114456278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114456278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114456278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114456291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114456299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114456299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114456299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:59.215637 run osmo-msc_10.42.42.6(pid=3642): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3642)] 11:44:59.264837 run osmo-msc_10.42.42.6(pid=3642): stdout: | (launched: 2022-12-10_11:44:58.086422) 11:44:59.315767 run osmo-msc_10.42.42.6(pid=3642): stderr: | 20221210114458407 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114458407 DLGLOBAL DEBUG validating counter group 0x7f715549ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114458407 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114458407 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114458408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114458408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114458411 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114458412 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114458412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114458412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:59.366800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3635): Terminating (SIGTERM) 11:44:59.407854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3638): Terminating (SIGTERM) 11:44:59.448793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3641): Terminating (SIGTERM) 11:44:59.490092 --- ParallelTerminationStrategy: PID 3635 died... 11:44:59.510013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3635): Terminated: ok {rc=0} 11:44:59.555605 --- ParallelTerminationStrategy: PID 3638 died... 11:44:59.574646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3638): Terminated: ok {rc=0} 11:44:59.619991 --- ParallelTerminationStrategy: PID 3641 died... 11:44:59.639248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3641): Terminated: ok {rc=0} 11:44:59.725907 bus /sierra_3: Setting Powered False 11:45:00.823142 bus /sierra_3: Setting Powered False 11:45:01.961214 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:45:03.107262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:03.119138 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:45:03.188236 tst mo_mt_call_osmux.py: using LAC 28166 11:45:03.304895 tst mo_mt_call_osmux.py: using RAC 116 11:45:03.424581 tst mo_mt_call_osmux.py: using CellId 28166 11:45:03.543211 tst mo_mt_call_osmux.py: using BVCI 28167 11:45:03.652122 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:03.663481 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:03.674674 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:03.686298 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:03.697522 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:03.708632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:03.828099 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:03.944540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:04.406942 run create_hlr_db(pid=3647): Launched 11:45:04.519918 bus /sierra_2: Setting Powered False 11:45:05.579332 run create_hlr_db(pid=3647): Terminated: ok {rc=0} 11:45:06.017249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3649): Launched 11:45:06.338022 run osmo-hlr_10.42.42.2(pid=3650): Launched 11:45:06.460931 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:07.012030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3652): Launched 11:45:07.331676 run osmo-stp_10.42.42.5(pid=3653): Launched 11:45:07.453145 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:08.032534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3655): Launched 11:45:08.352359 run osmo-msc_10.42.42.6(pid=3656): Launched 11:45:08.531259 run osmo-stp_10.42.42.5(pid=3653): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3653)] 11:45:08.667269 run osmo-stp_10.42.42.5(pid=3653): stdout: | (launched: 2022-12-10_11:45:07.273540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:08.802138 run osmo-stp_10.42.42.5(pid=3653): stderr: | 20221210114507465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114507465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114507465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114507466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114507466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114507466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114507466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:08.936403 run osmo-stp_10.42.42.5(pid=3653): stdout: | (launched: 2022-12-10_11:45:07.273540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:09.064125 run osmo-stp_10.42.42.5(pid=3653): stderr: | 20221210114507465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114507465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114507465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114507466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114507466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114507466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114507466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:09.217064 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3653): Process ended prematurely: osmo-stp_10.42.42.5(pid=3653) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3653)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:45:09.226672 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:45:09.254396 run osmo-hlr_10.42.42.2(pid=3650): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3650)] 11:45:09.304040 run osmo-hlr_10.42.42.2(pid=3650): stdout: | (launched: 2022-12-10_11:45:06.279908) 11:45:09.355159 run osmo-hlr_10.42.42.2(pid=3650): stderr: | 20221210114506480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114506480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114506481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114506481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114506481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114506481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114506494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114506502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114506502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114506502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:09.426540 run osmo-msc_10.42.42.6(pid=3656): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3656)] 11:45:09.476104 run osmo-msc_10.42.42.6(pid=3656): stdout: | (launched: 2022-12-10_11:45:08.294027) 11:45:09.527406 run osmo-msc_10.42.42.6(pid=3656): stderr: | 20221210114508617 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114508618 DLGLOBAL DEBUG validating counter group 0x7f54bc67fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114508618 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114508618 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114508618 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114508618 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114508620 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114508620 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114508620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114508620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:09.579008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3649): Terminating (SIGTERM) 11:45:09.620232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3652): Terminating (SIGTERM) 11:45:09.661630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3655): Terminating (SIGTERM) 11:45:09.703190 --- ParallelTerminationStrategy: PID 3649 died... 11:45:09.722884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3649): Terminated: ok {rc=0} 11:45:09.769115 --- ParallelTerminationStrategy: PID 3652 died... 11:45:09.788297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3652): Terminated: ok {rc=0} 11:45:09.833737 --- ParallelTerminationStrategy: PID 3655 died... 11:45:09.852932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3655): Terminated: ok {rc=0} 11:45:09.939833 bus /sierra_3: Setting Powered False 11:45:11.038871 bus /sierra_3: Setting Powered False 11:45:12.154197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:45:13.415601 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:13.422604 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:45:13.456671 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:45:13.483722 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:45:13.536254 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:45:13.570302 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:45:13.597034 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:45:14.151210 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:45:14.202082 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:14.213686 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:45:14.285251 tst mo_mt_call.py: using LAC 28167 11:45:14.410034 tst mo_mt_call.py: using RAC 117 11:45:14.536145 tst mo_mt_call.py: using CellId 28167 11:45:14.655746 tst mo_mt_call.py: using BVCI 28168 11:45:14.772687 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:14.784253 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:14.795655 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:14.806997 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:14.818447 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:14.829856 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:14.942178 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:15.055813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:15.517815 run create_hlr_db(pid=3661): Launched 11:45:15.633335 bus /sierra_2: Setting Powered False 11:45:16.696703 run create_hlr_db(pid=3661): Terminated: ok {rc=0} 11:45:17.153438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3664): Launched 11:45:17.482646 run osmo-hlr_10.42.42.2(pid=3665): Launched 11:45:17.605537 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:18.156625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3667): Launched 11:45:18.474461 run osmo-stp_10.42.42.5(pid=3668): Launched 11:45:18.597019 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:19.173367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3670): Launched 11:45:19.492129 run osmo-msc_10.42.42.6(pid=3671): Launched 11:45:19.671014 run osmo-stp_10.42.42.5(pid=3668): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3668)] 11:45:19.805342 run osmo-stp_10.42.42.5(pid=3668): stdout: | (launched: 2022-12-10_11:45:18.416663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:19.940129 run osmo-stp_10.42.42.5(pid=3668): stderr: | 20221210114518608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114518608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114518608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114518609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114518609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114518609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114518609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:20.074454 run osmo-stp_10.42.42.5(pid=3668): stdout: | (launched: 2022-12-10_11:45:18.416663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:20.201809 run osmo-stp_10.42.42.5(pid=3668): stderr: | 20221210114518608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114518608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114518608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114518609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114518609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114518609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114518609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:20.354139 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3668): Process ended prematurely: osmo-stp_10.42.42.5(pid=3668) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3668)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:45:20.363639 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:45:20.390828 run osmo-hlr_10.42.42.2(pid=3665): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3665)] 11:45:20.440198 run osmo-hlr_10.42.42.2(pid=3665): stdout: | (launched: 2022-12-10_11:45:17.424809) 11:45:20.491274 run osmo-hlr_10.42.42.2(pid=3665): stderr: | 20221210114517623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114517623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114517623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114517623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114517623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114517623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114517634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114517642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114517642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114517642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:20.562867 run osmo-msc_10.42.42.6(pid=3671): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3671)] 11:45:20.612441 run osmo-msc_10.42.42.6(pid=3671): stdout: | (launched: 2022-12-10_11:45:19.434176) 11:45:20.663811 run osmo-msc_10.42.42.6(pid=3671): stderr: | 20221210114519756 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114519756 DLGLOBAL DEBUG validating counter group 0x7fc760fb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114519756 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114519757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114519757 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114519757 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114519759 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114519759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114519759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114519759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:20.715317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3664): Terminating (SIGTERM) 11:45:20.756456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3667): Terminating (SIGTERM) 11:45:20.797711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3670): Terminating (SIGTERM) 11:45:20.839167 --- ParallelTerminationStrategy: PID 3664 died... 11:45:20.858920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3664): Terminated: ok {rc=0} 11:45:20.904590 --- ParallelTerminationStrategy: PID 3667 died... 11:45:20.923842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3667): Terminated: ok {rc=0} 11:45:20.969167 --- ParallelTerminationStrategy: PID 3670 died... 11:45:20.988279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3670): Terminated: ok {rc=0} 11:45:21.074563 bus /sierra_3: Setting Powered False 11:45:22.172473 bus /sierra_3: Setting Powered False 11:45:23.286285 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:45:24.434918 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:24.447318 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:45:24.520243 tst mo_mt_call_osmux.py: using LAC 28168 11:45:24.646281 tst mo_mt_call_osmux.py: using RAC 118 11:45:24.773156 tst mo_mt_call_osmux.py: using CellId 28168 11:45:24.890674 tst mo_mt_call_osmux.py: using BVCI 28169 11:45:25.007686 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:25.019452 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:25.030880 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:25.042312 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:25.053977 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:25.065404 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:25.178977 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:25.293227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:25.754117 run create_hlr_db(pid=3673): Launched 11:45:25.868475 bus /sierra_2: Setting Powered False 11:45:26.928552 run create_hlr_db(pid=3673): Terminated: ok {rc=0} 11:45:27.365751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3675): Launched 11:45:27.685127 run osmo-hlr_10.42.42.2(pid=3676): Launched 11:45:27.807210 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:28.355166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3678): Launched 11:45:28.673910 run osmo-stp_10.42.42.5(pid=3679): Launched 11:45:28.796458 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:29.373606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3681): Launched 11:45:29.693506 run osmo-msc_10.42.42.6(pid=3682): Launched 11:45:29.871198 run osmo-stp_10.42.42.5(pid=3679): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3679)] 11:45:30.005922 run osmo-stp_10.42.42.5(pid=3679): stdout: | (launched: 2022-12-10_11:45:28.616088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.140631 run osmo-stp_10.42.42.5(pid=3679): stderr: | 20221210114528807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114528807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114528807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114528808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114528808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114528808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114528808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:30.274733 run osmo-stp_10.42.42.5(pid=3679): stdout: | (launched: 2022-12-10_11:45:28.616088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.402205 run osmo-stp_10.42.42.5(pid=3679): stderr: | 20221210114528807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114528807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114528807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114528808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114528808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114528808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114528808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:30.555210 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3679): Process ended prematurely: osmo-stp_10.42.42.5(pid=3679) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3679)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:45:30.564581 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:45:30.592300 run osmo-hlr_10.42.42.2(pid=3676): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3676)] 11:45:30.641701 run osmo-hlr_10.42.42.2(pid=3676): stdout: | (launched: 2022-12-10_11:45:27.627369) 11:45:30.692874 run osmo-hlr_10.42.42.2(pid=3676): stderr: | 20221210114527824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114527824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114527824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114527824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114527824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114527824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114527835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114527843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114527844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114527844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:30.764590 run osmo-msc_10.42.42.6(pid=3682): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3682)] 11:45:30.814078 run osmo-msc_10.42.42.6(pid=3682): stdout: | (launched: 2022-12-10_11:45:29.635354) 11:45:30.866376 run osmo-msc_10.42.42.6(pid=3682): stderr: | 20221210114529956 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114529956 DLGLOBAL DEBUG validating counter group 0x7f682a03fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114529956 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114529956 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114529957 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114529957 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114529959 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114529959 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114529959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114529959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:30.932690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3675): Terminating (SIGTERM) 11:45:30.974879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3678): Terminating (SIGTERM) 11:45:31.016918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3681): Terminating (SIGTERM) 11:45:31.063478 --- ParallelTerminationStrategy: PID 3675 died... 11:45:31.083557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3675): Terminated: ok {rc=0} 11:45:31.133041 --- ParallelTerminationStrategy: PID 3678 died... 11:45:31.153377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3678): Terminated: ok {rc=0} 11:45:31.200924 --- ParallelTerminationStrategy: PID 3681 died... 11:45:31.220778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3681): Terminated: ok {rc=0} 11:45:31.312231 bus /sierra_3: Setting Powered False 11:45:32.409388 bus /sierra_3: Setting Powered False 11:45:33.524482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:45:34.775333 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:34.781318 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:45:34.815810 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:45:34.842220 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:45:34.895669 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:45:34.931725 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:45:34.959223 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:45:35.502121 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:45:35.551186 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:35.562348 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:45:35.632085 tst mo_mt_call.py: using LAC 28169 11:45:35.750921 tst mo_mt_call.py: using RAC 119 11:45:35.867433 tst mo_mt_call.py: using CellId 28169 11:45:35.985368 tst mo_mt_call.py: using BVCI 28170 11:45:36.093536 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:36.104383 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:36.115132 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:36.126170 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:36.137284 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:36.148146 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:45:36.265800 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:45:36.386135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:36.881758 run create_hlr_db(pid=3687): Launched 11:45:37.011543 bus /sierra_2: Setting Powered False 11:45:38.074695 run create_hlr_db(pid=3687): Terminated: ok {rc=0} 11:45:38.501958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3689): Launched 11:45:38.801231 run osmo-hlr_10.42.42.2(pid=3690): Launched 11:45:38.915137 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:39.443748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3692): Launched 11:45:39.742735 run osmo-stp_10.42.42.5(pid=3693): Launched 11:45:39.856866 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:40.396200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3695): Launched 11:45:40.696837 run osmo-msc_10.42.42.6(pid=3696): Launched 11:45:40.865696 run osmo-stp_10.42.42.5(pid=3693): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3693)] 11:45:40.993256 run osmo-stp_10.42.42.5(pid=3693): stdout: | (launched: 2022-12-10_11:45:39.688077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:41.120426 run osmo-stp_10.42.42.5(pid=3693): stderr: | 20221210114539857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114539857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114539857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114539858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114539860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114539860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114539860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:41.244804 run osmo-stp_10.42.42.5(pid=3693): stdout: | (launched: 2022-12-10_11:45:39.688077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:41.364092 run osmo-stp_10.42.42.5(pid=3693): stderr: | 20221210114539857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114539857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114539857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114539858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114539860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114539860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114539860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:41.507028 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3693): Process ended prematurely: osmo-stp_10.42.42.5(pid=3693) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3693)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:45:41.515890 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:45:41.542532 run osmo-hlr_10.42.42.2(pid=3690): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3690)] 11:45:41.590578 run osmo-hlr_10.42.42.2(pid=3690): stdout: | (launched: 2022-12-10_11:45:38.746996) 11:45:41.640111 run osmo-hlr_10.42.42.2(pid=3690): stderr: | 20221210114538942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114538942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114538942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114538942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114538942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114538942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114538955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114538965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114538966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114538966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:41.709240 run osmo-msc_10.42.42.6(pid=3696): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3696)] 11:45:41.756869 run osmo-msc_10.42.42.6(pid=3696): stdout: | (launched: 2022-12-10_11:45:40.642354) 11:45:41.806123 run osmo-msc_10.42.42.6(pid=3696): stderr: | 20221210114540916 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114540916 DLGLOBAL DEBUG validating counter group 0x7f3c19da3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114540917 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114540917 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114540917 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114540917 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114540919 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114540919 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114540919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114540919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:41.855876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3689): Terminating (SIGTERM) 11:45:41.895601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3692): Terminating (SIGTERM) 11:45:41.935306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3695): Terminating (SIGTERM) 11:45:41.975099 --- ParallelTerminationStrategy: PID 3689 died... 11:45:41.994060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3689): Terminated: ok {rc=0} 11:45:42.038118 --- ParallelTerminationStrategy: PID 3692 died... 11:45:42.056611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3692): Terminated: ok {rc=0} 11:45:42.101031 --- ParallelTerminationStrategy: PID 3695 died... 11:45:42.119603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3695): Terminated: ok {rc=0} 11:45:42.203177 bus /sierra_3: Setting Powered False 11:45:43.297407 bus /sierra_3: Setting Powered False 11:45:44.412381 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:45:45.557733 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:45.569912 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:45:45.640064 tst mo_mt_call_osmux.py: using LAC 28170 11:45:45.760781 tst mo_mt_call_osmux.py: using RAC 120 11:45:45.881948 tst mo_mt_call_osmux.py: using CellId 28170 11:45:46.018453 tst mo_mt_call_osmux.py: using BVCI 28171 11:45:46.164081 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:46.175930 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:46.187388 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:46.199123 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:46.210871 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:46.222839 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:45:46.339653 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:45:46.491792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:47.037472 run create_hlr_db(pid=3698): Launched 11:45:47.198841 bus /sierra_2: Setting Powered False 11:45:48.262547 run create_hlr_db(pid=3698): Terminated: ok {rc=0} 11:45:48.690079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3700): Launched 11:45:48.989719 run osmo-hlr_10.42.42.2(pid=3701): Launched 11:45:49.103654 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:49.621064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3703): Launched 11:45:49.918768 run osmo-stp_10.42.42.5(pid=3704): Launched 11:45:50.032328 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:50.570535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3706): Launched 11:45:50.869738 run osmo-msc_10.42.42.6(pid=3707): Launched 11:45:51.037874 run osmo-stp_10.42.42.5(pid=3704): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3704)] 11:45:51.172061 run osmo-stp_10.42.42.5(pid=3704): stdout: | (launched: 2022-12-10_11:45:49.864433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:51.309378 run osmo-stp_10.42.42.5(pid=3704): stderr: | 20221210114550033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114550033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114550034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114550034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114550034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114550035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114550035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:51.441963 run osmo-stp_10.42.42.5(pid=3704): stdout: | (launched: 2022-12-10_11:45:49.864433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:51.569985 run osmo-stp_10.42.42.5(pid=3704): stderr: | 20221210114550033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114550033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114550034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114550034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114550034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114550035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114550035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:51.722459 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3704): Process ended prematurely: osmo-stp_10.42.42.5(pid=3704) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3704)] [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:45:51.731875 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:45:51.759329 run osmo-hlr_10.42.42.2(pid=3701): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3701)] 11:45:51.808737 run osmo-hlr_10.42.42.2(pid=3701): stdout: | (launched: 2022-12-10_11:45:48.935686) 11:45:51.859900 run osmo-hlr_10.42.42.2(pid=3701): stderr: | 20221210114549110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114549110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114549110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114549110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114549110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114549110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114549123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114549132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114549132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114549132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:51.931048 run osmo-msc_10.42.42.6(pid=3707): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3707)] 11:45:51.980509 run osmo-msc_10.42.42.6(pid=3707): stdout: | (launched: 2022-12-10_11:45:50.815136) 11:45:52.031588 run osmo-msc_10.42.42.6(pid=3707): stderr: | 20221210114551086 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114551086 DLGLOBAL DEBUG validating counter group 0x7fdf0efecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114551086 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114551086 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114551086 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114551087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114551089 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114551089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114551089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114551089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:52.083156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3700): Terminating (SIGTERM) 11:45:52.124354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3703): Terminating (SIGTERM) 11:45:52.165760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3706): Terminating (SIGTERM) 11:45:52.207419 --- ParallelTerminationStrategy: PID 3700 died... 11:45:52.227007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3700): Terminated: ok {rc=0} 11:45:52.272554 --- ParallelTerminationStrategy: PID 3703 died... 11:45:52.291762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3703): Terminated: ok {rc=0} 11:45:52.337352 --- ParallelTerminationStrategy: PID 3706 died... 11:45:52.356568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3706): Terminated: ok {rc=0} 11:45:52.442465 bus /sierra_3: Setting Powered False 11:45:53.540653 bus /sierra_3: Setting Powered False 11:45:54.654220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 11:45:55.905916 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:55.910555 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:45:55.944741 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:45:55.971766 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 11:45:56.063416 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:45:56.097859 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:45:56.124708 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 11:45:56.707048 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 11:45:56.712137 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:56.723262 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:45:56.773891 tst emergency_mo_mt_call.py: using LAC 28171 11:45:56.897088 tst emergency_mo_mt_call.py: using RAC 121 11:45:57.018065 tst emergency_mo_mt_call.py: using CellId 28171 11:45:57.138829 tst emergency_mo_mt_call.py: using BVCI 28172 11:45:57.251614 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:57.262803 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:57.273783 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:57.284640 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:57.295617 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:57.306579 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:45:57.420810 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:45:57.533376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:57.988039 run create_hlr_db(pid=3714): Launched 11:45:58.101434 bus /sierra_2: Setting Powered False 11:45:59.159921 run create_hlr_db(pid=3714): Terminated: ok {rc=0} 11:45:59.569256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3716): Launched 11:45:59.862346 run osmo-hlr_10.42.42.2(pid=3717): Launched 11:45:59.975141 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:00.478563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3719): Launched 11:46:00.771193 run osmo-stp_10.42.42.5(pid=3720): Launched 11:46:00.971342 tst emergency_mo_mt_call.py: using MSISDN 7718 11:46:01.247141 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:01.846278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3722): Launched 11:46:02.178930 run osmo-msc_10.42.42.6(pid=3723): Launched 11:46:02.376012 run osmo-stp_10.42.42.5(pid=3720): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3720)] 11:46:02.500939 run osmo-stp_10.42.42.5(pid=3720): stdout: | (launched: 2022-12-10_11:46:00.717709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:02.626206 run osmo-stp_10.42.42.5(pid=3720): stderr: | 20221210114600930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114600930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114600931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114600931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114600932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114600932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114600932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:02.748879 run osmo-stp_10.42.42.5(pid=3720): stdout: | (launched: 2022-12-10_11:46:00.717709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:02.866902 run osmo-stp_10.42.42.5(pid=3720): stderr: | 20221210114600930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114600930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114600931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114600931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114600932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114600932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114600932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:03.008335 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3720): Process ended prematurely: osmo-stp_10.42.42.5(pid=3720) [trial-2374↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3720)] [trial-2374↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 11:46:03.016719 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 11:46:03.043674 run osmo-hlr_10.42.42.2(pid=3717): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3717)] 11:46:03.092642 run osmo-hlr_10.42.42.2(pid=3717): stdout: | (launched: 2022-12-10_11:45:59.808485) 11:46:03.143032 run osmo-hlr_10.42.42.2(pid=3717): stderr: | 20221210114559981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114559981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114559981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114559981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114559981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114559981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114559993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114600002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114600002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114600002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:03.213287 run osmo-msc_10.42.42.6(pid=3723): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3723)] 11:46:03.261793 run osmo-msc_10.42.42.6(pid=3723): stdout: | (launched: 2022-12-10_11:46:02.113117) 11:46:03.311729 run osmo-msc_10.42.42.6(pid=3723): stderr: | 20221210114602431 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114602431 DLGLOBAL DEBUG validating counter group 0x7f8507356c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114602431 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114602431 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114602431 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114602431 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114602433 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114602434 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114602434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114602434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:03.362679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3716): Terminating (SIGTERM) 11:46:03.402988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3719): Terminating (SIGTERM) 11:46:03.443348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3722): Terminating (SIGTERM) 11:46:03.483982 --- ParallelTerminationStrategy: PID 3716 died... 11:46:03.503176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3716): Terminated: ok {rc=0} 11:46:03.548260 --- ParallelTerminationStrategy: PID 3719 died... 11:46:03.566958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3719): Terminated: ok {rc=0} 11:46:03.611752 --- ParallelTerminationStrategy: PID 3722 died... 11:46:03.630570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3722): Terminated: ok {rc=0} 11:46:03.718710 bus /sierra_3: Setting Powered False 11:46:04.819719 bus /sierra_3: Setting Powered False 11:46:05.935608 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 11:46:07.023722 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:07.035326 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:46:07.086299 tst emergency_preemptive_call.py: using LAC 28172 11:46:07.201920 tst emergency_preemptive_call.py: using RAC 122 11:46:07.316734 tst emergency_preemptive_call.py: using CellId 28172 11:46:07.432317 tst emergency_preemptive_call.py: using BVCI 28173 11:46:07.538319 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:07.549616 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:07.560130 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:07.571250 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:07.582294 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:07.593361 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:07.709539 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:07.824416 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:07.936633 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:08.048941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:08.507574 run create_hlr_db(pid=3725): Launched 11:46:08.619691 bus /sierra_2: Setting Powered False 11:46:09.678740 run create_hlr_db(pid=3725): Terminated: ok {rc=0} 11:46:10.110817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3727): Launched 11:46:10.426119 run osmo-hlr_10.42.42.2(pid=3728): Launched 11:46:10.547473 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:11.095633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3730): Launched 11:46:11.410373 run osmo-stp_10.42.42.5(pid=3731): Launched 11:46:11.544047 tst emergency_preemptive_call.py: using MSISDN 7719 11:46:11.707215 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:12.272176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3733): Launched 11:46:12.588338 run osmo-msc_10.42.42.6(pid=3734): Launched 11:46:12.764291 run osmo-stp_10.42.42.5(pid=3731): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3731)] 11:46:12.897421 run osmo-stp_10.42.42.5(pid=3731): stdout: | (launched: 2022-12-10_11:46:11.353102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:13.032342 run osmo-stp_10.42.42.5(pid=3731): stderr: | 20221210114611543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114611543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114611543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114611544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114611544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114611544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114611544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:13.165668 run osmo-stp_10.42.42.5(pid=3731): stdout: | (launched: 2022-12-10_11:46:11.353102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:13.291741 run osmo-stp_10.42.42.5(pid=3731): stderr: | 20221210114611543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114611543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114611543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114611544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114611544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114611544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114611544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:13.442120 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3731): Process ended prematurely: osmo-stp_10.42.42.5(pid=3731) [trial-2374↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3731)] [trial-2374↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 11:46:13.451203 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 11:46:13.479281 run osmo-hlr_10.42.42.2(pid=3728): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3728)] 11:46:13.529866 run osmo-hlr_10.42.42.2(pid=3728): stdout: | (launched: 2022-12-10_11:46:10.368839) 11:46:13.582265 run osmo-hlr_10.42.42.2(pid=3728): stderr: | 20221210114610565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114610565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114610565 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114610566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114610566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114610566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114610578 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114610586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114610586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114610586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:13.654949 run osmo-msc_10.42.42.6(pid=3734): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3734)] 11:46:13.705477 run osmo-msc_10.42.42.6(pid=3734): stdout: | (launched: 2022-12-10_11:46:12.530093) 11:46:13.757617 run osmo-msc_10.42.42.6(pid=3734): stderr: | 20221210114612854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210114612854 DLGLOBAL DEBUG validating counter group 0x7f915177ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210114612854 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210114612854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210114612854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210114612854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210114612856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210114612856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210114612857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210114612857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:13.809743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3727): Terminating (SIGTERM) 11:46:13.851856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3730): Terminating (SIGTERM) 11:46:13.893857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3733): Terminating (SIGTERM) 11:46:13.935961 --- ParallelTerminationStrategy: PID 3727 died... 11:46:13.955988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3727): Terminated: ok {rc=0} 11:46:14.002412 --- ParallelTerminationStrategy: PID 3730 died... 11:46:14.021984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3730): Terminated: ok {rc=0} 11:46:14.068096 --- ParallelTerminationStrategy: PID 3733 died... 11:46:14.087873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3733): Terminated: ok {rc=0} 11:46:14.175665 bus /sierra_9: Setting Powered False 11:46:15.275198 bus /sierra_9: Setting Powered False 11:46:16.396131 bus /sierra_8: Setting Powered False 11:46:17.492206 bus /sierra_8: Setting Powered False 11:46:18.607806 bus /sierra_3: Setting Powered False 11:46:19.707854 bus /sierra_3: Setting Powered False 11:46:20.825074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 11:46:22.112619 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:22.117275 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:46:22.151292 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 11:46:22.190350 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 11:46:22.278750 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:46:22.312553 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 11:46:22.351338 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 11:46:22.944045 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 11:46:22.995549 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.006364 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:46:23.055753 tst cs_paging_gprs_active.py: using LAC 28173 11:46:23.182959 tst cs_paging_gprs_active.py: using RAC 123 11:46:23.308387 tst cs_paging_gprs_active.py: using CellId 28173 11:46:23.433556 tst cs_paging_gprs_active.py: using BVCI 28174 11:46:23.549877 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.561047 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.571919 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.582814 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.593745 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.604587 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.615628 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.626458 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:23.637467 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:23.753681 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:23.868877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:46:24.085554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:24.406029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3739): Launched 11:46:24.685271 run iperf3-srv_10.42.42.10(pid=3740): Launched 11:46:24.805725 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:46:25.021437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:25.342831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Launched 11:46:25.621436 run iperf3-srv_10.42.42.10(pid=3742): Launched 11:46:25.741264 tst cs_paging_gprs_active.py:38: start network... 11:46:25.956680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:26.452379 run create_hlr_db(pid=3743): Launched 11:46:26.583013 bus /sierra_2: Setting Powered False 11:46:27.646346 run create_hlr_db(pid=3743): Terminated: ok {rc=0} 11:46:28.090565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3745): Launched 11:46:28.412033 run osmo-hlr_10.42.42.2(pid=3746): Launched 11:46:28.534382 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:29.067735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3748): Launched 11:46:29.370490 run osmo-stp_10.42.42.5(pid=3749): Launched 11:46:29.486199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:46:30.004319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3751): Launched 11:46:30.121233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:46:30.375969 run patchelf(pid=3752): Launched 11:46:30.543943 run osmo-stp_10.42.42.5(pid=3749): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3749)] 11:46:30.671873 run osmo-stp_10.42.42.5(pid=3749): stdout: | (launched: 2022-12-10_11:46:29.315110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:30.800631 run osmo-stp_10.42.42.5(pid=3749): stderr: | 20221210114629483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114629483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114629483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114629484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114629484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114629484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114629484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:30.957418 run osmo-stp_10.42.42.5(pid=3749): stdout: | (launched: 2022-12-10_11:46:29.315110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:31.091729 run osmo-stp_10.42.42.5(pid=3749): stderr: | 20221210114629483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114629483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114629483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114629484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114629484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114629484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114629484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:31.242788 run patchelf(pid=3752): Terminating (SIGINT) 11:46:31.417189 run patchelf(pid=3752): Terminated: ok {rc=0} 11:46:31.543497 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3749): Process ended prematurely: osmo-stp_10.42.42.5(pid=3749) [trial-2374↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3749)] [trial-2374↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 11:46:31.554310 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:46:31.585151 run osmo-hlr_10.42.42.2(pid=3746): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3746)] 11:46:31.636034 run osmo-hlr_10.42.42.2(pid=3746): stdout: | (launched: 2022-12-10_11:46:28.354032) 11:46:31.688456 run osmo-hlr_10.42.42.2(pid=3746): stderr: | 20221210114628552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114628552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114628553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114628553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114628553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114628553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114628563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114628572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114628572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114628572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:31.741501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3739): Terminating (SIGTERM) 11:46:31.784636 run iperf3-srv_10.42.42.10(pid=3740): Terminating (SIGTERM) 11:46:31.829900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Terminating (SIGTERM) 11:46:31.873292 run iperf3-srv_10.42.42.10(pid=3742): Terminating (SIGTERM) 11:46:31.919064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3745): Terminating (SIGTERM) 11:46:31.961868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3748): Terminating (SIGTERM) 11:46:32.004692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3751): Terminating (SIGTERM) 11:46:32.048840 --- ParallelTerminationStrategy: PID 3739 died... 11:46:32.068696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3739): Terminated: ok {rc=0} 11:46:32.116350 --- ParallelTerminationStrategy: PID 3740 died... 11:46:32.135660 run iperf3-srv_10.42.42.10(pid=3740): Terminated {rc=256} 11:46:32.182789 --- ParallelTerminationStrategy: PID 3741 died... 11:46:32.202385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Terminated: ok {rc=0} 11:46:32.247609 --- ParallelTerminationStrategy: PID 3742 died... 11:46:32.266169 run iperf3-srv_10.42.42.10(pid=3742): Terminated {rc=256} 11:46:32.310706 --- ParallelTerminationStrategy: PID 3745 died... 11:46:32.329451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3745): Terminated: ok {rc=0} 11:46:32.373992 --- ParallelTerminationStrategy: PID 3748 died... 11:46:32.392632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3748): Terminated: ok {rc=0} 11:46:32.437237 --- ParallelTerminationStrategy: PID 3751 died... 11:46:32.455886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3751): Terminated: ok {rc=0} 11:46:32.540098 bus /gobi_0: Setting Powered False 11:46:33.637547 bus /gobi_0: Setting Powered False 11:46:34.754383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 11:46:35.899597 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:35.910902 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:46:35.962708 tst iperf3.py: using LAC 28174 11:46:36.081474 tst iperf3.py: using RAC 124 11:46:36.201193 tst iperf3.py: using CellId 28174 11:46:36.318762 tst iperf3.py: using BVCI 28175 11:46:36.427525 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.438349 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.448726 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.459430 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.469988 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.480498 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.491380 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.501936 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:36.512744 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:36.631132 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:46:36.849113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:37.170036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3753): Launched 11:46:37.449709 run iperf3-srv_10.42.42.10(pid=3754): Launched 11:46:37.570616 tst iperf3.py:8: start network... 11:46:37.787645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:38.284255 run create_hlr_db(pid=3755): Launched 11:46:38.415602 bus /gobi_6: Setting Powered False 11:46:39.478704 run create_hlr_db(pid=3755): Terminated: ok {rc=0} 11:46:39.906826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3757): Launched 11:46:40.206988 run osmo-hlr_10.42.42.2(pid=3758): Launched 11:46:40.322116 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:40.854941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3760): Launched 11:46:41.154879 run osmo-stp_10.42.42.5(pid=3761): Launched 11:46:41.269872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:46:41.786849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3763): Launched 11:46:41.902125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:46:42.156203 run patchelf(pid=3764): Launched 11:46:42.323532 run osmo-stp_10.42.42.5(pid=3761): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3761)] 11:46:42.450660 run osmo-stp_10.42.42.5(pid=3761): stdout: | (launched: 2022-12-10_11:46:41.099941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:42.579900 run osmo-stp_10.42.42.5(pid=3761): stderr: | 20221210114641270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114641270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114641270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114641271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114641271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114641271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114641271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:42.708917 run osmo-stp_10.42.42.5(pid=3761): stdout: | (launched: 2022-12-10_11:46:41.099941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:42.832269 run osmo-stp_10.42.42.5(pid=3761): stderr: | 20221210114641270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114641270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114641270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114641271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114641271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114641271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114641271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:42.978305 run patchelf(pid=3764): Terminating (SIGINT) 11:46:43.147735 run patchelf(pid=3764): Terminated: ok {rc=0} 11:46:43.269530 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3761): Process ended prematurely: osmo-stp_10.42.42.5(pid=3761) [trial-2374↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3761)] [trial-2374↪gprs:trx-sysmocell5000↪iperf3.py:8] 11:46:43.278977 tst iperf3.py:8: Test FAILED (7.4 sec) 11:46:43.306692 run osmo-hlr_10.42.42.2(pid=3758): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3758)] 11:46:43.354495 run osmo-hlr_10.42.42.2(pid=3758): stdout: | (launched: 2022-12-10_11:46:40.152641) 11:46:43.403677 run osmo-hlr_10.42.42.2(pid=3758): stderr: | 20221210114640328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114640328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114640328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114640328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114640328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114640328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114640353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114640362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114640362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114640362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:43.453554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3753): Terminating (SIGTERM) 11:46:43.493147 run iperf3-srv_10.42.42.10(pid=3754): Terminating (SIGTERM) 11:46:43.532778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3757): Terminating (SIGTERM) 11:46:43.572584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3760): Terminating (SIGTERM) 11:46:43.612215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3763): Terminating (SIGTERM) 11:46:43.652149 --- ParallelTerminationStrategy: PID 3753 died... 11:46:43.671156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3753): Terminated: ok {rc=0} 11:46:43.715680 --- ParallelTerminationStrategy: PID 3754 died... 11:46:43.734159 run iperf3-srv_10.42.42.10(pid=3754): Terminated {rc=256} 11:46:43.778149 --- ParallelTerminationStrategy: PID 3757 died... 11:46:43.796832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3757): Terminated: ok {rc=0} 11:46:43.841209 --- ParallelTerminationStrategy: PID 3760 died... 11:46:43.859535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3760): Terminated: ok {rc=0} 11:46:43.903791 --- ParallelTerminationStrategy: PID 3763 died... 11:46:43.922366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3763): Terminated: ok {rc=0} 11:46:44.005607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 11:46:45.153319 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.165915 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:46:45.220877 tst iperf3m4.py: using LAC 28175 11:46:45.350977 tst iperf3m4.py: using RAC 125 11:46:45.477676 tst iperf3m4.py: using CellId 28175 11:46:45.603158 tst iperf3m4.py: using BVCI 28176 11:46:45.719599 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.730937 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.741825 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.753309 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.764627 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.776020 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.787522 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.798801 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:46:45.810301 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:45.957685 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:46.085136 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:46.203291 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:46:46.345441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:46:46.582956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:46.902132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Launched 11:46:47.184144 run iperf3-srv_10.42.42.10(pid=3766): Launched 11:46:47.308859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:46:47.510216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:47.810979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3767): Launched 11:46:48.071446 run iperf3-srv_10.42.42.10(pid=3768): Launched 11:46:48.184360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:46:48.385236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:48.686143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3769): Launched 11:46:48.946291 run iperf3-srv_10.42.42.10(pid=3770): Launched 11:46:49.058818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:46:49.258929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:49.560027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3771): Launched 11:46:49.821146 run iperf3-srv_10.42.42.10(pid=3772): Launched 11:46:49.934257 tst iperf3m4.py:8: start network... 11:46:50.135069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:50.597487 run create_hlr_db(pid=3773): Launched 11:46:50.713417 bus /gobi_6: Setting Powered False 11:46:51.773372 run create_hlr_db(pid=3773): Terminated: ok {rc=0} 11:46:52.191979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3775): Launched 11:46:52.493112 run osmo-hlr_10.42.42.2(pid=3776): Launched 11:46:52.607998 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:53.140291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3778): Launched 11:46:53.441448 run osmo-stp_10.42.42.5(pid=3779): Launched 11:46:53.556867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:46:54.074725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3781): Launched 11:46:54.189587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:46:54.442819 run patchelf(pid=3782): Launched 11:46:54.610193 run osmo-stp_10.42.42.5(pid=3779): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3779)] 11:46:54.736919 run osmo-stp_10.42.42.5(pid=3779): stdout: | (launched: 2022-12-10_11:46:53.386151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:54.865285 run osmo-stp_10.42.42.5(pid=3779): stderr: | 20221210114653557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114653558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114653558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114653558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114653559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114653559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114653559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:54.993676 run osmo-stp_10.42.42.5(pid=3779): stdout: | (launched: 2022-12-10_11:46:53.386151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:55.116345 run osmo-stp_10.42.42.5(pid=3779): stderr: | 20221210114653557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114653558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114653558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114653558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114653559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114653559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114653559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:55.261998 run patchelf(pid=3782): Terminating (SIGINT) 11:46:55.431408 run patchelf(pid=3782): Terminated: ok {rc=0} 11:46:55.552578 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3779): Process ended prematurely: osmo-stp_10.42.42.5(pid=3779) [trial-2374↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3779)] [trial-2374↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 11:46:55.562182 tst iperf3m4.py:8: Test FAILED (10.4 sec) 11:46:55.590051 run osmo-hlr_10.42.42.2(pid=3776): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3776)] 11:46:55.637863 run osmo-hlr_10.42.42.2(pid=3776): stdout: | (launched: 2022-12-10_11:46:52.438140) 11:46:55.687058 run osmo-hlr_10.42.42.2(pid=3776): stderr: | 20221210114652613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114652613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114652613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114652613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114652613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114652613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114652626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114652634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114652634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114652634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:55.736773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Terminating (SIGTERM) 11:46:55.776916 run iperf3-srv_10.42.42.10(pid=3766): Terminating (SIGTERM) 11:46:55.817114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3767): Terminating (SIGTERM) 11:46:55.857285 run iperf3-srv_10.42.42.10(pid=3768): Terminating (SIGTERM) 11:46:55.897346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3769): Terminating (SIGTERM) 11:46:55.938147 run iperf3-srv_10.42.42.10(pid=3770): Terminating (SIGTERM) 11:46:55.978156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3771): Terminating (SIGTERM) 11:46:56.018099 run iperf3-srv_10.42.42.10(pid=3772): Terminating (SIGTERM) 11:46:56.057997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3775): Terminating (SIGTERM) 11:46:56.097631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3778): Terminating (SIGTERM) 11:46:56.137349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3781): Terminating (SIGTERM) 11:46:56.177723 --- ParallelTerminationStrategy: PID 3765 died... 11:46:56.196652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Terminated: ok {rc=0} 11:46:56.241386 --- ParallelTerminationStrategy: PID 3766 died... 11:46:56.260012 run iperf3-srv_10.42.42.10(pid=3766): Terminated {rc=256} 11:46:56.305102 --- ParallelTerminationStrategy: PID 3767 died... 11:46:56.323710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3767): Terminated: ok {rc=0} 11:46:56.368332 --- ParallelTerminationStrategy: PID 3768 died... 11:46:56.387071 run iperf3-srv_10.42.42.10(pid=3768): Terminated {rc=256} 11:46:56.431608 --- ParallelTerminationStrategy: PID 3769 died... 11:46:56.450361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3769): Terminated: ok {rc=0} 11:46:56.494725 --- ParallelTerminationStrategy: PID 3770 died... 11:46:56.513298 run iperf3-srv_10.42.42.10(pid=3770): Terminated {rc=256} 11:46:56.557657 --- ParallelTerminationStrategy: PID 3771 died... 11:46:56.576468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3771): Terminated: ok {rc=0} 11:46:56.620853 --- ParallelTerminationStrategy: PID 3772 died... 11:46:56.639881 run iperf3-srv_10.42.42.10(pid=3772): Terminated {rc=256} 11:46:56.684473 --- ParallelTerminationStrategy: PID 3775 died... 11:46:56.703265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3775): Terminated: ok {rc=0} 11:46:56.748215 --- ParallelTerminationStrategy: PID 3778 died... 11:46:56.766902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3778): Terminated: ok {rc=0} 11:46:56.811265 --- ParallelTerminationStrategy: PID 3781 died... 11:46:56.829936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3781): Terminated: ok {rc=0} 11:46:56.916701 bus /gobi_4: Setting Powered False 11:46:58.017390 bus /gobi_4: Setting Powered False 11:46:59.133067 bus /gobi_1: Setting Powered False 11:47:00.231681 bus /gobi_1: Setting Powered False 11:47:01.346717 bus /gobi_0: Setting Powered False 11:47:02.448908 bus /gobi_0: Setting Powered False 11:47:03.567113 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 11:47:04.671203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:04.682961 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:47:04.733420 tst ping.py: using LAC 28176 11:47:04.850833 tst ping.py: using RAC 126 11:47:04.967674 tst ping.py: using CellId 28176 11:47:05.093941 tst ping.py: using BVCI 28177 11:47:05.202033 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:05.213059 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:05.223516 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:05.234256 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:05.244877 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:05.255515 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:05.266260 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:05.276912 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:47:05.393388 tst ping.py:19: start network... 11:47:05.607696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:06.095635 run create_hlr_db(pid=3783): Launched 11:47:06.223784 bus /gobi_6: Setting Powered False 11:47:07.287211 run create_hlr_db(pid=3783): Terminated: ok {rc=0} 11:47:07.709195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3785): Launched 11:47:08.002057 run osmo-hlr_10.42.42.2(pid=3786): Launched 11:47:08.114686 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:08.621791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3788): Launched 11:47:08.915611 run osmo-stp_10.42.42.5(pid=3789): Launched 11:47:09.028185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:09.535344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3791): Launched 11:47:09.648685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:09.896744 run patchelf(pid=3792): Launched 11:47:10.061213 run osmo-stp_10.42.42.5(pid=3789): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3789)] 11:47:10.186319 run osmo-stp_10.42.42.5(pid=3789): stdout: | (launched: 2022-12-10_11:47:08.862089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:10.312808 run osmo-stp_10.42.42.5(pid=3789): stderr: | 20221210114709031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114709031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114709031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114709032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114709032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114709032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114709032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:10.439166 run osmo-stp_10.42.42.5(pid=3789): stdout: | (launched: 2022-12-10_11:47:08.862089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:10.559656 run osmo-stp_10.42.42.5(pid=3789): stderr: | 20221210114709031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114709031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114709031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114709032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114709032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114709032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114709032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:10.702554 run patchelf(pid=3792): Terminating (SIGINT) 11:47:10.867293 run patchelf(pid=3792): Terminated: ok {rc=0} 11:47:10.985898 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3789): Process ended prematurely: osmo-stp_10.42.42.5(pid=3789) [trial-2374↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3789)] [trial-2374↪gprs:trx-sysmocell5000↪ping.py:22] 11:47:10.994618 tst ping.py:22: Test FAILED (6.3 sec) 11:47:11.021905 run osmo-hlr_10.42.42.2(pid=3786): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3786)] 11:47:11.070384 run osmo-hlr_10.42.42.2(pid=3786): stdout: | (launched: 2022-12-10_11:47:07.948129) 11:47:11.120054 run osmo-hlr_10.42.42.2(pid=3786): stderr: | 20221210114708124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114708125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114708125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114708125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114708125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114708125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114708157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114708166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114708167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114708167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:11.170222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3785): Terminating (SIGTERM) 11:47:11.210220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3788): Terminating (SIGTERM) 11:47:11.250139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3791): Terminating (SIGTERM) 11:47:11.290413 --- ParallelTerminationStrategy: PID 3785 died... 11:47:11.309546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3785): Terminated: ok {rc=0} 11:47:11.354307 --- ParallelTerminationStrategy: PID 3788 died... 11:47:11.372910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3788): Terminated: ok {rc=0} 11:47:11.417613 --- ParallelTerminationStrategy: PID 3791 died... 11:47:11.436165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3791): Terminated: ok {rc=0} 11:47:11.520725 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 11:47:12.608499 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:12.620891 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:47:12.674540 tst ping_idle_ping.py: using LAC 28177 11:47:12.799763 tst ping_idle_ping.py: using RAC 127 11:47:12.923138 tst ping_idle_ping.py: using CellId 28177 11:47:13.046704 tst ping_idle_ping.py: using BVCI 28178 11:47:13.161368 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:13.172640 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:13.183955 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:13.195592 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:13.207216 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:13.218385 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:13.229735 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:47:13.240813 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:47:13.358003 tst ping_idle_ping.py:24: start network... 11:47:13.571183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:14.063501 run create_hlr_db(pid=3793): Launched 11:47:14.192262 bus /gobi_6: Setting Powered False 11:47:15.256213 run create_hlr_db(pid=3793): Terminated: ok {rc=0} 11:47:15.680005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3795): Launched 11:47:15.999695 run osmo-hlr_10.42.42.2(pid=3796): Launched 11:47:16.155016 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:16.911270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3798): Launched 11:47:17.229804 run osmo-stp_10.42.42.5(pid=3799): Launched 11:47:17.455565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:18.007825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3801): Launched 11:47:18.128219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:18.393706 run patchelf(pid=3802): Launched 11:47:18.568926 run osmo-stp_10.42.42.5(pid=3799): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3799)] 11:47:18.703003 run osmo-stp_10.42.42.5(pid=3799): stdout: | (launched: 2022-12-10_11:47:17.161827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:18.837799 run osmo-stp_10.42.42.5(pid=3799): stderr: | 20221210114717404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114717404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114717404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114717404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114717405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114717405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114717405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:18.972663 run osmo-stp_10.42.42.5(pid=3799): stdout: | (launched: 2022-12-10_11:47:17.161827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:19.102483 run osmo-stp_10.42.42.5(pid=3799): stderr: | 20221210114717404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114717404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114717404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114717404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114717405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114717405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114717405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:19.255533 run patchelf(pid=3802): Terminating (SIGINT) 11:47:19.431855 run patchelf(pid=3802): Terminated: ok {rc=0} 11:47:19.559001 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3799): Process ended prematurely: osmo-stp_10.42.42.5(pid=3799) [trial-2374↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3799)] [trial-2374↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 11:47:19.568334 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 11:47:19.596659 run osmo-hlr_10.42.42.2(pid=3796): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3796)] 11:47:19.646517 run osmo-hlr_10.42.42.2(pid=3796): stdout: | (launched: 2022-12-10_11:47:15.939561) 11:47:19.697788 run osmo-hlr_10.42.42.2(pid=3796): stderr: | 20221210114716319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114716320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114716320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114716320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114716321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114716321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114716351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114716368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114716369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114716369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:19.749714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3795): Terminating (SIGTERM) 11:47:19.791246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3798): Terminating (SIGTERM) 11:47:19.832823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3801): Terminating (SIGTERM) 11:47:19.874521 --- ParallelTerminationStrategy: PID 3795 died... 11:47:19.894418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3795): Terminated: ok {rc=0} 11:47:19.940355 --- ParallelTerminationStrategy: PID 3798 died... 11:47:19.959925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3798): Terminated: ok {rc=0} 11:47:20.005466 --- ParallelTerminationStrategy: PID 3801 died... 11:47:20.024832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3801): Terminated: ok {rc=0} 11:47:20.111699 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 11:47:21.423983 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:21.430105 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:47:21.463676 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:47:21.501397 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:47:21.586502 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:47:21.619618 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:47:21.657317 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:47:22.251983 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:47:22.300770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.311726 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:47:22.362755 tst cs_paging_gprs_active.py: using LAC 28178 11:47:22.482361 tst cs_paging_gprs_active.py: using RAC 128 11:47:22.600680 tst cs_paging_gprs_active.py: using CellId 28178 11:47:22.719696 tst cs_paging_gprs_active.py: using BVCI 28179 11:47:22.839036 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.850436 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.861620 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.873257 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.884788 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.896390 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.908181 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.919661 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:22.931459 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:23.046708 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:23.166821 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:47:23.384742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:23.707677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3806): Launched 11:47:23.985911 run iperf3-srv_10.42.42.10(pid=3807): Launched 11:47:24.105984 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:47:24.322167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:24.643822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3808): Launched 11:47:24.921970 run iperf3-srv_10.42.42.10(pid=3809): Launched 11:47:25.041853 tst cs_paging_gprs_active.py:38: start network... 11:47:25.258002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:25.755443 run create_hlr_db(pid=3810): Launched 11:47:25.885956 bus /gobi_6: Setting Powered False 11:47:26.948843 run create_hlr_db(pid=3810): Terminated: ok {rc=0} 11:47:27.377656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3812): Launched 11:47:27.679671 run osmo-hlr_10.42.42.2(pid=3813): Launched 11:47:27.794323 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:28.323789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3815): Launched 11:47:28.624557 run osmo-stp_10.42.42.5(pid=3816): Launched 11:47:28.739358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:29.257719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3818): Launched 11:47:29.373403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:29.626820 run patchelf(pid=3819): Launched 11:47:29.794235 run osmo-stp_10.42.42.5(pid=3816): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3816)] 11:47:29.921119 run osmo-stp_10.42.42.5(pid=3816): stdout: | (launched: 2022-12-10_11:47:28.569818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:30.049522 run osmo-stp_10.42.42.5(pid=3816): stderr: | 20221210114728741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114728741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114728742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114728742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114728742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114728743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114728743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:30.177985 run osmo-stp_10.42.42.5(pid=3816): stdout: | (launched: 2022-12-10_11:47:28.569818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:30.300693 run osmo-stp_10.42.42.5(pid=3816): stderr: | 20221210114728741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114728741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114728742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114728742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114728742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114728743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114728743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:30.446730 run patchelf(pid=3819): Terminating (SIGINT) 11:47:30.614858 run patchelf(pid=3819): Terminated: ok {rc=0} 11:47:30.736170 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3816): Process ended prematurely: osmo-stp_10.42.42.5(pid=3816) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3816)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:47:30.745624 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:47:30.772548 run osmo-hlr_10.42.42.2(pid=3813): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3813)] 11:47:30.820329 run osmo-hlr_10.42.42.2(pid=3813): stdout: | (launched: 2022-12-10_11:47:27.624366) 11:47:30.871568 run osmo-hlr_10.42.42.2(pid=3813): stderr: | 20221210114727799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114727799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114727799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114727799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114727799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114727799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114727811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114727820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114727820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114727820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:30.928057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3806): Terminating (SIGTERM) 11:47:30.969735 run iperf3-srv_10.42.42.10(pid=3807): Terminating (SIGTERM) 11:47:31.013895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3808): Terminating (SIGTERM) 11:47:31.056059 run iperf3-srv_10.42.42.10(pid=3809): Terminating (SIGTERM) 11:47:31.100339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3812): Terminating (SIGTERM) 11:47:31.142457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3815): Terminating (SIGTERM) 11:47:31.185923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3818): Terminating (SIGTERM) 11:47:31.229212 --- ParallelTerminationStrategy: PID 3806 died... 11:47:31.248836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3806): Terminated: ok {rc=0} 11:47:31.295084 --- ParallelTerminationStrategy: PID 3807 died... 11:47:31.314507 run iperf3-srv_10.42.42.10(pid=3807): Terminated {rc=256} 11:47:31.360425 --- ParallelTerminationStrategy: PID 3808 died... 11:47:31.379857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3808): Terminated: ok {rc=0} 11:47:31.425914 --- ParallelTerminationStrategy: PID 3809 died... 11:47:31.445275 run iperf3-srv_10.42.42.10(pid=3809): Terminated {rc=256} 11:47:31.490926 --- ParallelTerminationStrategy: PID 3812 died... 11:47:31.510235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3812): Terminated: ok {rc=0} 11:47:31.556026 --- ParallelTerminationStrategy: PID 3815 died... 11:47:31.575547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3815): Terminated: ok {rc=0} 11:47:31.621308 --- ParallelTerminationStrategy: PID 3818 died... 11:47:31.640619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3818): Terminated: ok {rc=0} 11:47:31.726825 bus /gobi_0: Setting Powered False 11:47:32.821914 bus /gobi_0: Setting Powered False 11:47:33.936358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:47:35.081788 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.093219 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:47:35.146200 tst iperf3.py: using LAC 28179 11:47:35.265356 tst iperf3.py: using RAC 129 11:47:35.385434 tst iperf3.py: using CellId 28179 11:47:35.502730 tst iperf3.py: using BVCI 28180 11:47:35.612556 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.623533 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.634316 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.645168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.655882 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.666852 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.677915 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.688735 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:35.699828 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:35.816698 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:47:36.034817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:36.357144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3825): Launched 11:47:36.636787 run iperf3-srv_10.42.42.10(pid=3826): Launched 11:47:36.757009 tst iperf3.py:8: start network... 11:47:36.973314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:37.470075 run create_hlr_db(pid=3827): Launched 11:47:37.589881 bus /gobi_6: Setting Powered False 11:47:38.649704 run create_hlr_db(pid=3827): Terminated: ok {rc=0} 11:47:39.066747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3829): Launched 11:47:39.368633 run osmo-hlr_10.42.42.2(pid=3830): Launched 11:47:39.483146 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:40.003277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3832): Launched 11:47:40.302499 run osmo-stp_10.42.42.5(pid=3833): Launched 11:47:40.416834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:40.931582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3835): Launched 11:47:41.046607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:41.299610 run patchelf(pid=3836): Launched 11:47:41.466516 run osmo-stp_10.42.42.5(pid=3833): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3833)] 11:47:41.593203 run osmo-stp_10.42.42.5(pid=3833): stdout: | (launched: 2022-12-10_11:47:40.247616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:41.721482 run osmo-stp_10.42.42.5(pid=3833): stderr: | 20221210114740418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114740418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114740418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114740419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114740419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114740419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114740419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:41.850744 run osmo-stp_10.42.42.5(pid=3833): stdout: | (launched: 2022-12-10_11:47:40.247616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:41.973333 run osmo-stp_10.42.42.5(pid=3833): stderr: | 20221210114740418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114740418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114740418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114740419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114740419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114740419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114740419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:42.119209 run patchelf(pid=3836): Terminating (SIGINT) 11:47:42.287410 run patchelf(pid=3836): Terminated: ok {rc=0} 11:47:42.408221 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3833): Process ended prematurely: osmo-stp_10.42.42.5(pid=3833) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3833)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 11:47:42.417711 tst iperf3.py:8: Test FAILED (7.4 sec) 11:47:42.445364 run osmo-hlr_10.42.42.2(pid=3830): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3830)] 11:47:42.492908 run osmo-hlr_10.42.42.2(pid=3830): stdout: | (launched: 2022-12-10_11:47:39.314120) 11:47:42.542142 run osmo-hlr_10.42.42.2(pid=3830): stderr: | 20221210114739491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114739491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114739491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114739491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114739491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114739492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114739503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114739512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114739512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114739512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:42.592254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3825): Terminating (SIGTERM) 11:47:42.631890 run iperf3-srv_10.42.42.10(pid=3826): Terminating (SIGTERM) 11:47:42.671578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3829): Terminating (SIGTERM) 11:47:42.711136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3832): Terminating (SIGTERM) 11:47:42.750589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3835): Terminating (SIGTERM) 11:47:42.790539 --- ParallelTerminationStrategy: PID 3825 died... 11:47:42.809358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3825): Terminated: ok {rc=0} 11:47:42.853587 --- ParallelTerminationStrategy: PID 3826 died... 11:47:42.872065 run iperf3-srv_10.42.42.10(pid=3826): Terminated {rc=256} 11:47:42.916214 --- ParallelTerminationStrategy: PID 3829 died... 11:47:42.934722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3829): Terminated: ok {rc=0} 11:47:42.979350 --- ParallelTerminationStrategy: PID 3832 died... 11:47:42.997824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3832): Terminated: ok {rc=0} 11:47:43.042085 --- ParallelTerminationStrategy: PID 3835 died... 11:47:43.060580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3835): Terminated: ok {rc=0} 11:47:43.147124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:47:44.293854 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.305341 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:47:44.357411 tst iperf3m4.py: using LAC 28180 11:47:44.477084 tst iperf3m4.py: using RAC 130 11:47:44.595833 tst iperf3m4.py: using CellId 28180 11:47:44.713370 tst iperf3m4.py: using BVCI 28181 11:47:44.822599 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.833577 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.844197 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.855591 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.867016 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.878600 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.890131 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.901451 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:44.912855 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:45.033542 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:45.148598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:45.265845 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:45.380779 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:47:45.583119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:45.897027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3837): Launched 11:47:46.233413 run iperf3-srv_10.42.42.10(pid=3838): Launched 11:47:46.380010 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:47:46.609735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:46.953725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3840): Launched 11:47:47.244925 run iperf3-srv_10.42.42.10(pid=3841): Launched 11:47:47.366102 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:47:47.583767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:47.906916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3842): Launched 11:47:48.186252 run iperf3-srv_10.42.42.10(pid=3843): Launched 11:47:48.306900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:47:48.523838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:48.845975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3844): Launched 11:47:49.124363 run iperf3-srv_10.42.42.10(pid=3845): Launched 11:47:49.244826 tst iperf3m4.py:8: start network... 11:47:49.461325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:49.958737 run create_hlr_db(pid=3846): Launched 11:47:50.088928 bus /gobi_6: Setting Powered False 11:47:51.152405 run create_hlr_db(pid=3846): Terminated: ok {rc=0} 11:47:51.582241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3848): Launched 11:47:51.883137 run osmo-hlr_10.42.42.2(pid=3849): Launched 11:47:51.998330 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:52.530336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3851): Launched 11:47:52.830160 run osmo-stp_10.42.42.5(pid=3852): Launched 11:47:52.944179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:53.459849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3854): Launched 11:47:53.575694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:53.829039 run patchelf(pid=3855): Launched 11:47:53.997386 run osmo-stp_10.42.42.5(pid=3852): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3852)] 11:47:54.124527 run osmo-stp_10.42.42.5(pid=3852): stdout: | (launched: 2022-12-10_11:47:52.775007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:54.253318 run osmo-stp_10.42.42.5(pid=3852): stderr: | 20221210114752944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114752945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114752945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114752945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114752946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114752946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114752946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:54.382325 run osmo-stp_10.42.42.5(pid=3852): stdout: | (launched: 2022-12-10_11:47:52.775007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:54.505422 run osmo-stp_10.42.42.5(pid=3852): stderr: | 20221210114752944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114752945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114752945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114752945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114752946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114752946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114752946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:54.651605 run patchelf(pid=3855): Terminating (SIGINT) 11:47:54.820470 run patchelf(pid=3855): Terminated: ok {rc=0} 11:47:54.942164 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3852): Process ended prematurely: osmo-stp_10.42.42.5(pid=3852) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3852)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 11:47:54.951631 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:47:54.979649 run osmo-hlr_10.42.42.2(pid=3849): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3849)] 11:47:55.027575 run osmo-hlr_10.42.42.2(pid=3849): stdout: | (launched: 2022-12-10_11:47:51.827981) 11:47:55.077229 run osmo-hlr_10.42.42.2(pid=3849): stderr: | 20221210114752001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114752001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114752002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114752002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114752002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114752002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114752014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114752023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114752023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114752023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:55.127421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3837): Terminating (SIGTERM) 11:47:55.167537 run iperf3-srv_10.42.42.10(pid=3838): Terminating (SIGTERM) 11:47:55.207445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3840): Terminating (SIGTERM) 11:47:55.247370 run iperf3-srv_10.42.42.10(pid=3841): Terminating (SIGTERM) 11:47:55.287265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3842): Terminating (SIGTERM) 11:47:55.327288 run iperf3-srv_10.42.42.10(pid=3843): Terminating (SIGTERM) 11:47:55.367035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3844): Terminating (SIGTERM) 11:47:55.407025 run iperf3-srv_10.42.42.10(pid=3845): Terminating (SIGTERM) 11:47:55.446761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3848): Terminating (SIGTERM) 11:47:55.486959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3851): Terminating (SIGTERM) 11:47:55.527122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3854): Terminating (SIGTERM) 11:47:55.567647 --- ParallelTerminationStrategy: PID 3837 died... 11:47:55.586845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3837): Terminated: ok {rc=0} 11:47:55.631780 --- ParallelTerminationStrategy: PID 3838 died... 11:47:55.650270 run iperf3-srv_10.42.42.10(pid=3838): Terminated {rc=256} 11:47:55.694503 --- ParallelTerminationStrategy: PID 3840 died... 11:47:55.713034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3840): Terminated: ok {rc=0} 11:47:55.757208 --- ParallelTerminationStrategy: PID 3841 died... 11:47:55.776162 run iperf3-srv_10.42.42.10(pid=3841): Terminated {rc=256} 11:47:55.821060 --- ParallelTerminationStrategy: PID 3842 died... 11:47:55.839759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3842): Terminated: ok {rc=0} 11:47:55.884292 --- ParallelTerminationStrategy: PID 3843 died... 11:47:55.902981 run iperf3-srv_10.42.42.10(pid=3843): Terminated {rc=256} 11:47:55.947367 --- ParallelTerminationStrategy: PID 3844 died... 11:47:55.966055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3844): Terminated: ok {rc=0} 11:47:56.010398 --- ParallelTerminationStrategy: PID 3845 died... 11:47:56.029030 run iperf3-srv_10.42.42.10(pid=3845): Terminated {rc=256} 11:47:56.073384 --- ParallelTerminationStrategy: PID 3848 died... 11:47:56.092006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3848): Terminated: ok {rc=0} 11:47:56.137100 --- ParallelTerminationStrategy: PID 3851 died... 11:47:56.155729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3851): Terminated: ok {rc=0} 11:47:56.200231 --- ParallelTerminationStrategy: PID 3854 died... 11:47:56.219144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3854): Terminated: ok {rc=0} 11:47:56.305649 bus /gobi_4: Setting Powered False 11:47:57.406042 bus /gobi_4: Setting Powered False 11:47:58.521694 bus /gobi_1: Setting Powered False 11:47:59.622407 bus /gobi_1: Setting Powered False 11:48:00.737755 bus /gobi_0: Setting Powered False 11:48:01.844693 bus /gobi_0: Setting Powered False 11:48:02.975024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 11:48:04.077840 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.089466 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:48:04.141868 tst ping.py: using LAC 28181 11:48:04.259179 tst ping.py: using RAC 131 11:48:04.375903 tst ping.py: using CellId 28181 11:48:04.492207 tst ping.py: using BVCI 28182 11:48:04.600480 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.611495 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.622162 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.633071 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.643897 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.654826 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.666123 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:04.676896 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:04.796070 tst ping.py:19: start network... 11:48:04.993397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:05.449318 run create_hlr_db(pid=3856): Launched 11:48:05.561762 bus /gobi_6: Setting Powered False 11:48:06.621275 run create_hlr_db(pid=3856): Terminated: ok {rc=0} 11:48:07.053674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3858): Launched 11:48:07.370167 run osmo-hlr_10.42.42.2(pid=3859): Launched 11:48:07.490294 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:08.035676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3861): Launched 11:48:08.350447 run osmo-stp_10.42.42.5(pid=3862): Launched 11:48:08.471156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:09.015553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3864): Launched 11:48:09.136432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:09.402553 run patchelf(pid=3865): Launched 11:48:09.577479 run osmo-stp_10.42.42.5(pid=3862): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3862)] 11:48:09.710841 run osmo-stp_10.42.42.5(pid=3862): stdout: | (launched: 2022-12-10_11:48:08.293050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:09.845269 run osmo-stp_10.42.42.5(pid=3862): stderr: | 20221210114808486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114808487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114808487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114808487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114808488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114808488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114808488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:09.979848 run osmo-stp_10.42.42.5(pid=3862): stdout: | (launched: 2022-12-10_11:48:08.293050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:10.109122 run osmo-stp_10.42.42.5(pid=3862): stderr: | 20221210114808486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114808487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114808487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114808487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114808488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114808488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114808488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:10.261868 run patchelf(pid=3865): Terminating (SIGINT) 11:48:10.437362 run patchelf(pid=3865): Terminated: ok {rc=0} 11:48:10.563824 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3862): Process ended prematurely: osmo-stp_10.42.42.5(pid=3862) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3862)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 11:48:10.573359 tst ping.py:22: Test FAILED (6.5 sec) 11:48:10.601161 run osmo-hlr_10.42.42.2(pid=3859): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3859)] 11:48:10.650886 run osmo-hlr_10.42.42.2(pid=3859): stdout: | (launched: 2022-12-10_11:48:07.312753) 11:48:10.702851 run osmo-hlr_10.42.42.2(pid=3859): stderr: | 20221210114807514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114807514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114807514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114807514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114807514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114807514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114807526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114807535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114807535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114807535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:10.754183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3858): Terminating (SIGTERM) 11:48:10.795512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3861): Terminating (SIGTERM) 11:48:10.837004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3864): Terminating (SIGTERM) 11:48:10.878677 --- ParallelTerminationStrategy: PID 3858 died... 11:48:10.898423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3858): Terminated: ok {rc=0} 11:48:10.944090 --- ParallelTerminationStrategy: PID 3861 died... 11:48:10.963485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3861): Terminated: ok {rc=0} 11:48:11.009132 --- ParallelTerminationStrategy: PID 3864 died... 11:48:11.028344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3864): Terminated: ok {rc=0} 11:48:11.115151 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:48:12.202807 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.215157 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:48:12.271555 tst ping_idle_ping.py: using LAC 28182 11:48:12.388313 tst ping_idle_ping.py: using RAC 132 11:48:12.502314 tst ping_idle_ping.py: using CellId 28182 11:48:12.617345 tst ping_idle_ping.py: using BVCI 28183 11:48:12.726961 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.738053 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.748805 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.760532 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.772122 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.783761 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.795720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:12.807348 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:12.928365 tst ping_idle_ping.py:24: start network... 11:48:13.142035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:13.633758 run create_hlr_db(pid=3866): Launched 11:48:13.762072 bus /gobi_6: Setting Powered False 11:48:14.825801 run create_hlr_db(pid=3866): Terminated: ok {rc=0} 11:48:15.249924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3868): Launched 11:48:15.545979 run osmo-hlr_10.42.42.2(pid=3869): Launched 11:48:15.660097 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:16.218247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3871): Launched 11:48:16.535169 run osmo-stp_10.42.42.5(pid=3872): Launched 11:48:16.767431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:17.426265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3874): Launched 11:48:17.539543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:17.789503 run patchelf(pid=3875): Launched 11:48:17.954638 run osmo-stp_10.42.42.5(pid=3872): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3872)] 11:48:18.080099 run osmo-stp_10.42.42.5(pid=3872): stdout: | (launched: 2022-12-10_11:48:16.474887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:18.207009 run osmo-stp_10.42.42.5(pid=3872): stderr: | 20221210114816804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114816804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114816804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114816805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114816805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114816805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114816805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:18.333595 run osmo-stp_10.42.42.5(pid=3872): stdout: | (launched: 2022-12-10_11:48:16.474887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:18.454844 run osmo-stp_10.42.42.5(pid=3872): stderr: | 20221210114816804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114816804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114816804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114816805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114816805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114816805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114816805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:18.598449 run patchelf(pid=3875): Terminating (SIGINT) 11:48:18.764436 run patchelf(pid=3875): Terminated: ok {rc=0} 11:48:18.884096 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3872): Process ended prematurely: osmo-stp_10.42.42.5(pid=3872) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3872)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 11:48:18.892935 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:48:18.920170 run osmo-hlr_10.42.42.2(pid=3869): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3869)] 11:48:18.967895 run osmo-hlr_10.42.42.2(pid=3869): stdout: | (launched: 2022-12-10_11:48:15.491907) 11:48:19.017197 run osmo-hlr_10.42.42.2(pid=3869): stderr: | 20221210114815666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114815666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114815666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114815666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114815667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114815667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114815679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114815687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114815687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114815687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:19.066643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3868): Terminating (SIGTERM) 11:48:19.106366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3871): Terminating (SIGTERM) 11:48:19.146313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3874): Terminating (SIGTERM) 11:48:19.186370 --- ParallelTerminationStrategy: PID 3868 died... 11:48:19.205349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3868): Terminated: ok {rc=0} 11:48:19.249953 --- ParallelTerminationStrategy: PID 3871 died... 11:48:19.268480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3871): Terminated: ok {rc=0} 11:48:19.312482 --- ParallelTerminationStrategy: PID 3874 died... 11:48:19.330949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3874): Terminated: ok {rc=0} 11:48:19.416346 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:48:20.729284 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:48:20.735257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:48:20.769165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:48:20.807004 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:48:20.890938 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:48:20.923873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:48:20.961519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:48:21.558474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:48:21.611976 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:21.623562 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:48:21.694795 tst cs_paging_gprs_active.py: using LAC 28183 11:48:21.819180 tst cs_paging_gprs_active.py: using RAC 133 11:48:21.943651 tst cs_paging_gprs_active.py: using CellId 28183 11:48:22.068231 tst cs_paging_gprs_active.py: using BVCI 28184 11:48:22.185848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.197188 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.208357 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.219562 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.230692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.241783 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.253059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.264039 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:22.275264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:22.389475 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:22.504635 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:48:22.707498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:23.009434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3879): Launched 11:48:23.270402 run iperf3-srv_10.42.42.10(pid=3880): Launched 11:48:23.383143 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:48:23.583845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:23.884427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3881): Launched 11:48:24.145731 run iperf3-srv_10.42.42.10(pid=3882): Launched 11:48:24.258511 tst cs_paging_gprs_active.py:38: start network... 11:48:24.459248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:24.923279 run create_hlr_db(pid=3883): Launched 11:48:25.038557 bus /gobi_6: Setting Powered False 11:48:26.098562 run create_hlr_db(pid=3883): Terminated: ok {rc=0} 11:48:26.538164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3885): Launched 11:48:26.860774 run osmo-hlr_10.42.42.2(pid=3886): Launched 11:48:26.983385 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:27.534842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3888): Launched 11:48:27.857119 run osmo-stp_10.42.42.5(pid=3889): Launched 11:48:27.980411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:28.535194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3891): Launched 11:48:28.658928 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:28.929162 run patchelf(pid=3892): Launched 11:48:29.107144 run osmo-stp_10.42.42.5(pid=3889): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3889)] 11:48:29.242989 run osmo-stp_10.42.42.5(pid=3889): stdout: | (launched: 2022-12-10_11:48:27.798857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:29.380216 run osmo-stp_10.42.42.5(pid=3889): stderr: | 20221210114827991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114827992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114827992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114827992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114827993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114827993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114827993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:29.517501 run osmo-stp_10.42.42.5(pid=3889): stdout: | (launched: 2022-12-10_11:48:27.798857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:29.649489 run osmo-stp_10.42.42.5(pid=3889): stderr: | 20221210114827991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114827992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114827992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114827992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114827993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114827993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114827993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:29.805260 run patchelf(pid=3892): Terminating (SIGINT) 11:48:29.984455 run patchelf(pid=3892): Terminated: ok {rc=0} 11:48:30.113871 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3889): Process ended prematurely: osmo-stp_10.42.42.5(pid=3889) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3889)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:48:30.123984 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:48:30.152361 run osmo-hlr_10.42.42.2(pid=3886): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3886)] 11:48:30.202342 run osmo-hlr_10.42.42.2(pid=3886): stdout: | (launched: 2022-12-10_11:48:26.802708) 11:48:30.253484 run osmo-hlr_10.42.42.2(pid=3886): stderr: | 20221210114827002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114827002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114827002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114827002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114827002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114827002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114827013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114827021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114827021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114827021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:30.305259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3879): Terminating (SIGTERM) 11:48:30.346597 run iperf3-srv_10.42.42.10(pid=3880): Terminating (SIGTERM) 11:48:30.387869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3881): Terminating (SIGTERM) 11:48:30.429262 run iperf3-srv_10.42.42.10(pid=3882): Terminating (SIGTERM) 11:48:30.470410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3885): Terminating (SIGTERM) 11:48:30.511604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3888): Terminating (SIGTERM) 11:48:30.552819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3891): Terminating (SIGTERM) 11:48:30.594794 --- ParallelTerminationStrategy: PID 3879 died... 11:48:30.614721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3879): Terminated: ok {rc=0} 11:48:30.660499 --- ParallelTerminationStrategy: PID 3880 died... 11:48:30.679939 run iperf3-srv_10.42.42.10(pid=3880): Terminated {rc=256} 11:48:30.725359 --- ParallelTerminationStrategy: PID 3881 died... 11:48:30.744628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3881): Terminated: ok {rc=0} 11:48:30.789909 --- ParallelTerminationStrategy: PID 3882 died... 11:48:30.809111 run iperf3-srv_10.42.42.10(pid=3882): Terminated {rc=256} 11:48:30.861649 --- ParallelTerminationStrategy: PID 3885 died... 11:48:30.883432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3885): Terminated: ok {rc=0} 11:48:30.941310 --- ParallelTerminationStrategy: PID 3888 died... 11:48:30.961149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3888): Terminated: ok {rc=0} 11:48:31.018703 --- ParallelTerminationStrategy: PID 3891 died... 11:48:31.042671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3891): Terminated: ok {rc=0} 11:48:31.136389 bus /gobi_0: Setting Powered False 11:48:32.246678 bus /gobi_0: Setting Powered False 11:48:33.358262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:48:34.505613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:34.517586 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:48:34.592119 tst iperf3.py: using LAC 28184 11:48:34.719207 tst iperf3.py: using RAC 134 11:48:34.848098 tst iperf3.py: using CellId 28184 11:48:34.973263 tst iperf3.py: using BVCI 28185 11:48:35.088864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.100219 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.111438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.122643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.133734 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.144794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.156124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.167211 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:35.178455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:35.295183 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:48:35.512424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:35.834118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3893): Launched 11:48:36.113329 run iperf3-srv_10.42.42.10(pid=3894): Launched 11:48:36.234364 tst iperf3.py:8: start network... 11:48:36.451264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:36.948041 run create_hlr_db(pid=3895): Launched 11:48:37.078505 bus /gobi_6: Setting Powered False 11:48:38.142101 run create_hlr_db(pid=3895): Terminated: ok {rc=0} 11:48:38.587763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3897): Launched 11:48:38.908607 run osmo-hlr_10.42.42.2(pid=3898): Launched 11:48:39.030490 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:39.586409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3900): Launched 11:48:39.907204 run osmo-stp_10.42.42.5(pid=3901): Launched 11:48:40.030523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:40.583599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3903): Launched 11:48:40.707182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:40.978447 run patchelf(pid=3904): Launched 11:48:41.157393 run osmo-stp_10.42.42.5(pid=3901): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3901)] 11:48:41.293261 run osmo-stp_10.42.42.5(pid=3901): stdout: | (launched: 2022-12-10_11:48:39.848871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:41.431381 run osmo-stp_10.42.42.5(pid=3901): stderr: | 20221210114840040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114840040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114840040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114840041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114840041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114840041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114840041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:41.569151 run osmo-stp_10.42.42.5(pid=3901): stdout: | (launched: 2022-12-10_11:48:39.848871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:41.701386 run osmo-stp_10.42.42.5(pid=3901): stderr: | 20221210114840040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114840040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114840040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114840041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114840041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114840041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114840041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:41.857565 run patchelf(pid=3904): Terminating (SIGINT) 11:48:42.037177 run patchelf(pid=3904): Terminated: ok {rc=0} 11:48:42.167055 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3901): Process ended prematurely: osmo-stp_10.42.42.5(pid=3901) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3901)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 11:48:42.176941 tst iperf3.py:8: Test FAILED (7.7 sec) 11:48:42.205561 run osmo-hlr_10.42.42.2(pid=3898): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3898)] 11:48:42.255782 run osmo-hlr_10.42.42.2(pid=3898): stdout: | (launched: 2022-12-10_11:48:38.850597) 11:48:42.307850 run osmo-hlr_10.42.42.2(pid=3898): stderr: | 20221210114839048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114839048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114839048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114839048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114839048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114839048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114839061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114839070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114839070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114839070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:42.360243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3893): Terminating (SIGTERM) 11:48:42.402213 run iperf3-srv_10.42.42.10(pid=3894): Terminating (SIGTERM) 11:48:42.443644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3897): Terminating (SIGTERM) 11:48:42.485144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3900): Terminating (SIGTERM) 11:48:42.526483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3903): Terminating (SIGTERM) 11:48:42.568197 --- ParallelTerminationStrategy: PID 3893 died... 11:48:42.588076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3893): Terminated: ok {rc=0} 11:48:42.634210 --- ParallelTerminationStrategy: PID 3894 died... 11:48:42.653457 run iperf3-srv_10.42.42.10(pid=3894): Terminated {rc=256} 11:48:42.699512 --- ParallelTerminationStrategy: PID 3897 died... 11:48:42.718836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3897): Terminated: ok {rc=0} 11:48:42.764564 --- ParallelTerminationStrategy: PID 3900 died... 11:48:42.783971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3900): Terminated: ok {rc=0} 11:48:42.829704 --- ParallelTerminationStrategy: PID 3903 died... 11:48:42.849203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3903): Terminated: ok {rc=0} 11:48:42.937308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:48:44.087621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.099569 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:48:44.171776 tst iperf3m4.py: using LAC 28185 11:48:44.299348 tst iperf3m4.py: using RAC 135 11:48:44.426726 tst iperf3m4.py: using CellId 28185 11:48:44.553618 tst iperf3m4.py: using BVCI 28186 11:48:44.670303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.681706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.692756 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.703921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.715120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.726319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.737600 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.748602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:44.760030 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:44.880024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:44.998341 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:45.117319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:45.232333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:48:45.435372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:45.737479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3905): Launched 11:48:46.013772 run iperf3-srv_10.42.42.10(pid=3906): Launched 11:48:46.134886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:48:46.341530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:46.699336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3907): Launched 11:48:47.022157 run iperf3-srv_10.42.42.10(pid=3908): Launched 11:48:47.147658 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:48:47.355282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:47.659828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3909): Launched 11:48:47.922228 run iperf3-srv_10.42.42.10(pid=3910): Launched 11:48:48.035215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:48:48.236438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:48.538176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3911): Launched 11:48:48.799567 run iperf3-srv_10.42.42.10(pid=3912): Launched 11:48:48.912683 tst iperf3m4.py:8: start network... 11:48:49.113936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:49.576883 run create_hlr_db(pid=3913): Launched 11:48:49.693378 bus /gobi_6: Setting Powered False 11:48:50.753471 run create_hlr_db(pid=3913): Terminated: ok {rc=0} 11:48:51.193237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3915): Launched 11:48:51.514996 run osmo-hlr_10.42.42.2(pid=3916): Launched 11:48:51.638941 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:52.195985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3918): Launched 11:48:52.516705 run osmo-stp_10.42.42.5(pid=3919): Launched 11:48:52.639457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:53.191754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3921): Launched 11:48:53.315489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:53.586366 run patchelf(pid=3922): Launched 11:48:53.765375 run osmo-stp_10.42.42.5(pid=3919): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3919)] 11:48:53.901074 run osmo-stp_10.42.42.5(pid=3919): stdout: | (launched: 2022-12-10_11:48:52.458267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:54.038851 run osmo-stp_10.42.42.5(pid=3919): stderr: | 20221210114852653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114852653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114852653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114852654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114852654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114852654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114852654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:54.176364 run osmo-stp_10.42.42.5(pid=3919): stdout: | (launched: 2022-12-10_11:48:52.458267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:54.307902 run osmo-stp_10.42.42.5(pid=3919): stderr: | 20221210114852653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114852653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114852653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114852654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114852654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114852654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114852654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:54.464829 run patchelf(pid=3922): Terminating (SIGINT) 11:48:54.645379 run patchelf(pid=3922): Terminated: ok {rc=0} 11:48:54.774748 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3919): Process ended prematurely: osmo-stp_10.42.42.5(pid=3919) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3919)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:48:54.784758 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:48:54.813488 run osmo-hlr_10.42.42.2(pid=3916): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3916)] 11:48:54.863403 run osmo-hlr_10.42.42.2(pid=3916): stdout: | (launched: 2022-12-10_11:48:51.456692) 11:48:54.915081 run osmo-hlr_10.42.42.2(pid=3916): stderr: | 20221210114851657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114851657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114851657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114851657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114851657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114851657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114851667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114851676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114851676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114851676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:54.967111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3905): Terminating (SIGTERM) 11:48:55.008938 run iperf3-srv_10.42.42.10(pid=3906): Terminating (SIGTERM) 11:48:55.050741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3907): Terminating (SIGTERM) 11:48:55.092663 run iperf3-srv_10.42.42.10(pid=3908): Terminating (SIGTERM) 11:48:55.134246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3909): Terminating (SIGTERM) 11:48:55.176023 run iperf3-srv_10.42.42.10(pid=3910): Terminating (SIGTERM) 11:48:55.217508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3911): Terminating (SIGTERM) 11:48:55.259172 run iperf3-srv_10.42.42.10(pid=3912): Terminating (SIGTERM) 11:48:55.300648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3915): Terminating (SIGTERM) 11:48:55.342821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3918): Terminating (SIGTERM) 11:48:55.384369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3921): Terminating (SIGTERM) 11:48:55.426238 --- ParallelTerminationStrategy: PID 3905 died... 11:48:55.446175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3905): Terminated: ok {rc=0} 11:48:55.492233 --- ParallelTerminationStrategy: PID 3906 died... 11:48:55.511783 run iperf3-srv_10.42.42.10(pid=3906): Terminated {rc=256} 11:48:55.557953 --- ParallelTerminationStrategy: PID 3907 died... 11:48:55.577394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3907): Terminated: ok {rc=0} 11:48:55.623903 --- ParallelTerminationStrategy: PID 3908 died... 11:48:55.643413 run iperf3-srv_10.42.42.10(pid=3908): Terminated {rc=256} 11:48:55.689579 --- ParallelTerminationStrategy: PID 3909 died... 11:48:55.709247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3909): Terminated: ok {rc=0} 11:48:55.755218 --- ParallelTerminationStrategy: PID 3910 died... 11:48:55.774754 run iperf3-srv_10.42.42.10(pid=3910): Terminated {rc=256} 11:48:55.820720 --- ParallelTerminationStrategy: PID 3911 died... 11:48:55.840339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3911): Terminated: ok {rc=0} 11:48:55.886401 --- ParallelTerminationStrategy: PID 3912 died... 11:48:55.905998 run iperf3-srv_10.42.42.10(pid=3912): Terminated {rc=256} 11:48:55.952243 --- ParallelTerminationStrategy: PID 3915 died... 11:48:55.971889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3915): Terminated: ok {rc=0} 11:48:56.018136 --- ParallelTerminationStrategy: PID 3918 died... 11:48:56.037871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3918): Terminated: ok {rc=0} 11:48:56.084245 --- ParallelTerminationStrategy: PID 3921 died... 11:48:56.104007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3921): Terminated: ok {rc=0} 11:48:56.191756 bus /gobi_4: Setting Powered False 11:48:57.291607 bus /gobi_4: Setting Powered False 11:48:58.409977 bus /gobi_1: Setting Powered False 11:48:59.510517 bus /gobi_1: Setting Powered False 11:49:00.625911 bus /gobi_0: Setting Powered False 11:49:01.732311 bus /gobi_0: Setting Powered False 11:49:02.864575 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:49:03.968298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:03.980432 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:49:04.053341 tst ping.py: using LAC 28186 11:49:04.181512 tst ping.py: using RAC 136 11:49:04.305155 tst ping.py: using CellId 28186 11:49:04.426491 tst ping.py: using BVCI 28187 11:49:04.543330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:04.554826 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:04.566148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:04.577478 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:04.588582 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:04.599840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:04.611236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:04.622487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:04.735098 tst ping.py:19: start network... 11:49:04.933872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:05.391336 run create_hlr_db(pid=3923): Launched 11:49:05.504516 bus /gobi_6: Setting Powered False 11:49:06.563849 run create_hlr_db(pid=3923): Terminated: ok {rc=0} 11:49:06.998431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3925): Launched 11:49:07.314070 run osmo-hlr_10.42.42.2(pid=3926): Launched 11:49:07.433927 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:07.982389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3928): Launched 11:49:08.297541 run osmo-stp_10.42.42.5(pid=3929): Launched 11:49:08.418982 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:08.966279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3931): Launched 11:49:09.087078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:09.354076 run patchelf(pid=3932): Launched 11:49:09.528880 run osmo-stp_10.42.42.5(pid=3929): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3929)] 11:49:09.662364 run osmo-stp_10.42.42.5(pid=3929): stdout: | (launched: 2022-12-10_11:49:08.240220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:09.797259 run osmo-stp_10.42.42.5(pid=3929): stderr: | 20221210114908432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114908432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114908432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114908433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114908433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114908433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114908433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:09.932155 run osmo-stp_10.42.42.5(pid=3929): stdout: | (launched: 2022-12-10_11:49:08.240220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:10.061483 run osmo-stp_10.42.42.5(pid=3929): stderr: | 20221210114908432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114908432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114908432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114908433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114908433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114908433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114908433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:10.215037 run patchelf(pid=3932): Terminating (SIGINT) 11:49:10.391429 run patchelf(pid=3932): Terminated: ok {rc=0} 11:49:10.518667 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3929): Process ended prematurely: osmo-stp_10.42.42.5(pid=3929) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3929)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 11:49:10.528000 tst ping.py:22: Test FAILED (6.6 sec) 11:49:10.556109 run osmo-hlr_10.42.42.2(pid=3926): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3926)] 11:49:10.606687 run osmo-hlr_10.42.42.2(pid=3926): stdout: | (launched: 2022-12-10_11:49:07.256658) 11:49:10.658395 run osmo-hlr_10.42.42.2(pid=3926): stderr: | 20221210114907452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114907452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114907452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114907453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114907453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114907453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114907466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114907474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114907474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114907474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:10.710187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3925): Terminating (SIGTERM) 11:49:10.751743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3928): Terminating (SIGTERM) 11:49:10.793580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3931): Terminating (SIGTERM) 11:49:10.836080 --- ParallelTerminationStrategy: PID 3925 died... 11:49:10.856177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3925): Terminated: ok {rc=0} 11:49:10.902646 --- ParallelTerminationStrategy: PID 3928 died... 11:49:10.922363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3928): Terminated: ok {rc=0} 11:49:10.968788 --- ParallelTerminationStrategy: PID 3931 died... 11:49:10.988820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3931): Terminated: ok {rc=0} 11:49:11.076691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:49:12.162086 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.173926 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:49:12.244551 tst ping_idle_ping.py: using LAC 28187 11:49:12.362236 tst ping_idle_ping.py: using RAC 137 11:49:12.484567 tst ping_idle_ping.py: using CellId 28187 11:49:12.604287 tst ping_idle_ping.py: using BVCI 28188 11:49:12.711359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.722372 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.733162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.744080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.755069 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.766032 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.777288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:12.788123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:12.903278 tst ping_idle_ping.py:24: start network... 11:49:13.101801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:13.567756 run create_hlr_db(pid=3933): Launched 11:49:13.681821 bus /gobi_6: Setting Powered False 11:49:14.741746 run create_hlr_db(pid=3933): Terminated: ok {rc=0} 11:49:15.175994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3935): Launched 11:49:15.493062 run osmo-hlr_10.42.42.2(pid=3936): Launched 11:49:15.615102 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:16.201983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3938): Launched 11:49:16.539219 run osmo-stp_10.42.42.5(pid=3939): Launched 11:49:16.822828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:17.408926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3941): Launched 11:49:17.529899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:17.796428 run patchelf(pid=3942): Launched 11:49:17.971710 run osmo-stp_10.42.42.5(pid=3939): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3939)] 11:49:18.104882 run osmo-stp_10.42.42.5(pid=3939): stdout: | (launched: 2022-12-10_11:49:16.476460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:18.239756 run osmo-stp_10.42.42.5(pid=3939): stderr: | 20221210114916715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114916715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114916716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114916716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114916717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114916717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114916717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:18.375012 run osmo-stp_10.42.42.5(pid=3939): stdout: | (launched: 2022-12-10_11:49:16.476460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:18.504139 run osmo-stp_10.42.42.5(pid=3939): stderr: | 20221210114916715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114916715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114916716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114916716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114916717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114916717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114916717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:18.658507 run patchelf(pid=3942): Terminating (SIGINT) 11:49:18.834664 run patchelf(pid=3942): Terminated: ok {rc=0} 11:49:18.961658 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3939): Process ended prematurely: osmo-stp_10.42.42.5(pid=3939) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3939)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:49:18.971089 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:49:18.998859 run osmo-hlr_10.42.42.2(pid=3936): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3936)] 11:49:19.048279 run osmo-hlr_10.42.42.2(pid=3936): stdout: | (launched: 2022-12-10_11:49:15.435614) 11:49:19.099321 run osmo-hlr_10.42.42.2(pid=3936): stderr: | 20221210114915635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114915635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114915635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114915635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114915635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114915635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114915647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114915657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114915658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114915658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:19.150934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3935): Terminating (SIGTERM) 11:49:19.192445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3938): Terminating (SIGTERM) 11:49:19.234030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3941): Terminating (SIGTERM) 11:49:19.275610 --- ParallelTerminationStrategy: PID 3935 died... 11:49:19.295334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3935): Terminated: ok {rc=0} 11:49:19.341260 --- ParallelTerminationStrategy: PID 3938 died... 11:49:19.360868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3938): Terminated: ok {rc=0} 11:49:19.406463 --- ParallelTerminationStrategy: PID 3941 died... 11:49:19.425738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3941): Terminated: ok {rc=0} 11:49:19.513460 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:49:20.825536 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:49:20.832377 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:49:20.866662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:49:20.905482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:49:20.992888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:49:21.026929 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:49:21.065843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:49:21.664288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:49:21.716190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:21.727599 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:49:21.799673 tst cs_paging_gprs_active.py: using LAC 28188 11:49:21.927580 tst cs_paging_gprs_active.py: using RAC 138 11:49:22.053569 tst cs_paging_gprs_active.py: using CellId 28188 11:49:22.179526 tst cs_paging_gprs_active.py: using BVCI 28189 11:49:22.297611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.308938 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.320231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.331388 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.342581 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.354077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.365331 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.376306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:22.387625 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:22.505803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:22.626895 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:49:22.845774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:23.167615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3948): Launched 11:49:23.445978 run iperf3-srv_10.42.42.10(pid=3949): Launched 11:49:23.566220 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:49:23.783719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:24.105680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3950): Launched 11:49:24.385083 run iperf3-srv_10.42.42.10(pid=3951): Launched 11:49:24.505624 tst cs_paging_gprs_active.py:38: start network... 11:49:24.723858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:25.222029 run create_hlr_db(pid=3952): Launched 11:49:25.352223 bus /gobi_6: Setting Powered False 11:49:26.416217 run create_hlr_db(pid=3952): Terminated: ok {rc=0} 11:49:26.864351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3954): Launched 11:49:27.185619 run osmo-hlr_10.42.42.2(pid=3955): Launched 11:49:27.308493 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:27.863666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3957): Launched 11:49:28.183968 run osmo-stp_10.42.42.5(pid=3958): Launched 11:49:28.306490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:28.860163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3960): Launched 11:49:28.983164 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:29.253457 run patchelf(pid=3961): Launched 11:49:29.431416 run osmo-stp_10.42.42.5(pid=3958): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3958)] 11:49:29.567131 run osmo-stp_10.42.42.5(pid=3958): stdout: | (launched: 2022-12-10_11:49:28.125935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:29.705337 run osmo-stp_10.42.42.5(pid=3958): stderr: | 20221210114928319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114928319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114928320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114928320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114928320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114928321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114928321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:29.842736 run osmo-stp_10.42.42.5(pid=3958): stdout: | (launched: 2022-12-10_11:49:28.125935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:29.973987 run osmo-stp_10.42.42.5(pid=3958): stderr: | 20221210114928319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114928319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114928320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114928320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114928320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114928321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114928321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:30.129929 run patchelf(pid=3961): Terminating (SIGINT) 11:49:30.309165 run patchelf(pid=3961): Terminated: ok {rc=0} 11:49:30.438521 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3958): Process ended prematurely: osmo-stp_10.42.42.5(pid=3958) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3958)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:49:30.448535 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:49:30.476940 run osmo-hlr_10.42.42.2(pid=3955): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3955)] 11:49:30.526914 run osmo-hlr_10.42.42.2(pid=3955): stdout: | (launched: 2022-12-10_11:49:27.127548) 11:49:30.578315 run osmo-hlr_10.42.42.2(pid=3955): stderr: | 20221210114927327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114927327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114927327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114927327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114927327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114927327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114927339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114927348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114927348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114927348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:30.630165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3948): Terminating (SIGTERM) 11:49:30.672412 run iperf3-srv_10.42.42.10(pid=3949): Terminating (SIGTERM) 11:49:30.714028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3950): Terminating (SIGTERM) 11:49:30.755537 run iperf3-srv_10.42.42.10(pid=3951): Terminating (SIGTERM) 11:49:30.796864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3954): Terminating (SIGTERM) 11:49:30.838617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3957): Terminating (SIGTERM) 11:49:30.885831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3960): Terminating (SIGTERM) 11:49:30.928341 --- ParallelTerminationStrategy: PID 3948 died... 11:49:30.948385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3948): Terminated: ok {rc=0} 11:49:30.994718 --- ParallelTerminationStrategy: PID 3949 died... 11:49:31.015231 run iperf3-srv_10.42.42.10(pid=3949): Terminated {rc=256} 11:49:31.061945 --- ParallelTerminationStrategy: PID 3950 died... 11:49:31.081837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3950): Terminated: ok {rc=0} 11:49:31.128551 --- ParallelTerminationStrategy: PID 3951 died... 11:49:31.148507 run iperf3-srv_10.42.42.10(pid=3951): Terminated {rc=256} 11:49:31.194873 --- ParallelTerminationStrategy: PID 3954 died... 11:49:31.214580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3954): Terminated: ok {rc=0} 11:49:31.261116 --- ParallelTerminationStrategy: PID 3957 died... 11:49:31.281040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3957): Terminated: ok {rc=0} 11:49:31.327803 --- ParallelTerminationStrategy: PID 3960 died... 11:49:31.348197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3960): Terminated: ok {rc=0} 11:49:31.437067 bus /gobi_0: Setting Powered False 11:49:32.534949 bus /gobi_0: Setting Powered False 11:49:33.650952 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:49:34.801656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:34.813637 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:49:34.888162 tst iperf3.py: using LAC 28189 11:49:35.015299 tst iperf3.py: using RAC 139 11:49:35.141351 tst iperf3.py: using CellId 28189 11:49:35.266715 tst iperf3.py: using BVCI 28190 11:49:35.383023 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.394521 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.405811 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.416892 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.428085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.439311 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.450569 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.461595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:35.472798 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:35.590990 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:35.808683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:36.130284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3962): Launched 11:49:36.409748 run iperf3-srv_10.42.42.10(pid=3963): Launched 11:49:36.530494 tst iperf3.py:8: start network... 11:49:36.747962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:37.244846 run create_hlr_db(pid=3964): Launched 11:49:37.375147 bus /gobi_6: Setting Powered False 11:49:38.434879 run create_hlr_db(pid=3964): Terminated: ok {rc=0} 11:49:38.882165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3966): Launched 11:49:39.202918 run osmo-hlr_10.42.42.2(pid=3967): Launched 11:49:39.335310 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:39.892233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3969): Launched 11:49:40.214509 run osmo-stp_10.42.42.5(pid=3970): Launched 11:49:40.336607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:40.890161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3972): Launched 11:49:41.013187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:41.284432 run patchelf(pid=3973): Launched 11:49:41.463034 run osmo-stp_10.42.42.5(pid=3970): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3970)] 11:49:41.599008 run osmo-stp_10.42.42.5(pid=3970): stdout: | (launched: 2022-12-10_11:49:40.156136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:41.737446 run osmo-stp_10.42.42.5(pid=3970): stderr: | 20221210114940350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114940350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114940350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114940351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114940351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114940351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114940351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:41.875161 run osmo-stp_10.42.42.5(pid=3970): stdout: | (launched: 2022-12-10_11:49:40.156136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:42.007047 run osmo-stp_10.42.42.5(pid=3970): stderr: | 20221210114940350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114940350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114940350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114940351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114940351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114940351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114940351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:42.163455 run patchelf(pid=3973): Terminating (SIGINT) 11:49:42.343948 run patchelf(pid=3973): Terminated: ok {rc=0} 11:49:42.473989 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3970): Process ended prematurely: osmo-stp_10.42.42.5(pid=3970) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3970)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 11:49:42.484132 tst iperf3.py:8: Test FAILED (7.7 sec) 11:49:42.512607 run osmo-hlr_10.42.42.2(pid=3967): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3967)] 11:49:42.562397 run osmo-hlr_10.42.42.2(pid=3967): stdout: | (launched: 2022-12-10_11:49:39.144551) 11:49:42.613650 run osmo-hlr_10.42.42.2(pid=3967): stderr: | 20221210114939353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114939353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114939354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114939354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114939354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114939354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114939366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114939376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114939377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114939377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:42.665576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3962): Terminating (SIGTERM) 11:49:42.707335 run iperf3-srv_10.42.42.10(pid=3963): Terminating (SIGTERM) 11:49:42.749081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3966): Terminating (SIGTERM) 11:49:42.790776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3969): Terminating (SIGTERM) 11:49:42.834581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3972): Terminating (SIGTERM) 11:49:42.876326 --- ParallelTerminationStrategy: PID 3962 died... 11:49:42.895347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3962): Terminated: ok {rc=0} 11:49:42.940842 --- ParallelTerminationStrategy: PID 3963 died... 11:49:42.959733 run iperf3-srv_10.42.42.10(pid=3963): Terminated {rc=256} 11:49:43.005189 --- ParallelTerminationStrategy: PID 3966 died... 11:49:43.023696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3966): Terminated: ok {rc=0} 11:49:43.069781 --- ParallelTerminationStrategy: PID 3969 died... 11:49:43.088326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3969): Terminated: ok {rc=0} 11:49:43.132811 --- ParallelTerminationStrategy: PID 3972 died... 11:49:43.151707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3972): Terminated: ok {rc=0} 11:49:43.237295 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:49:44.383884 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:44.395494 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:49:44.465767 tst iperf3m4.py: using LAC 28190 11:49:44.593769 tst iperf3m4.py: using RAC 140 11:49:44.712795 tst iperf3m4.py: using CellId 28190 11:49:44.831575 tst iperf3m4.py: using BVCI 28191 11:49:44.941735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:44.952580 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:44.963388 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:44.974327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:44.985270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:44.996122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:45.007162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:45.018059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:45.029123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:45.150010 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:45.266685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:45.385106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:45.504226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:45.722332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:46.098041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3975): Launched 11:49:46.395502 run iperf3-srv_10.42.42.10(pid=3976): Launched 11:49:46.562749 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:49:46.803354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:47.136626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3977): Launched 11:49:47.427981 run iperf3-srv_10.42.42.10(pid=3978): Launched 11:49:47.548457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:49:47.765228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:48.086814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3979): Launched 11:49:48.365670 run iperf3-srv_10.42.42.10(pid=3980): Launched 11:49:48.485848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:49:48.702150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:49.023393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3981): Launched 11:49:49.301750 run iperf3-srv_10.42.42.10(pid=3982): Launched 11:49:49.421870 tst iperf3m4.py:8: start network... 11:49:49.637651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:50.134022 run create_hlr_db(pid=3983): Launched 11:49:50.264269 bus /gobi_6: Setting Powered False 11:49:51.328580 run create_hlr_db(pid=3983): Terminated: ok {rc=0} 11:49:51.758294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3985): Launched 11:49:52.059867 run osmo-hlr_10.42.42.2(pid=3986): Launched 11:49:52.174982 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:52.708287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3988): Launched 11:49:53.009515 run osmo-stp_10.42.42.5(pid=3989): Launched 11:49:53.126277 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:53.645200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3991): Launched 11:49:53.760826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:54.014273 run patchelf(pid=3992): Launched 11:49:54.181118 run osmo-stp_10.42.42.5(pid=3989): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] 11:49:54.308230 run osmo-stp_10.42.42.5(pid=3989): stdout: | (launched: 2022-12-10_11:49:52.954448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:54.437354 run osmo-stp_10.42.42.5(pid=3989): stderr: | 20221210114953124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114953125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114953125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114953125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114953127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114953128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114953128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:54.566721 run osmo-stp_10.42.42.5(pid=3989): stdout: | (launched: 2022-12-10_11:49:52.954448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:54.689703 run osmo-stp_10.42.42.5(pid=3989): stderr: | 20221210114953124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210114953125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210114953125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210114953125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210114953127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210114953128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210114953128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:54.835903 run patchelf(pid=3992): Terminating (SIGINT) 11:49:55.004782 run patchelf(pid=3992): Terminated: ok {rc=0} 11:49:55.126420 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3989): Process ended prematurely: osmo-stp_10.42.42.5(pid=3989) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:49:55.135881 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:49:55.164121 run osmo-hlr_10.42.42.2(pid=3986): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3986)] 11:49:55.212441 run osmo-hlr_10.42.42.2(pid=3986): stdout: | (launched: 2022-12-10_11:49:52.005443) 11:49:55.262451 run osmo-hlr_10.42.42.2(pid=3986): stderr: | 20221210114952183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210114952183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210114952183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210114952183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210114952183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210114952183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210114952195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210114952204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210114952204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210114952204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:55.312913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3975): Terminating (SIGTERM) 11:49:55.353340 run iperf3-srv_10.42.42.10(pid=3976): Terminating (SIGTERM) 11:49:55.393815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3977): Terminating (SIGTERM) 11:49:55.434123 run iperf3-srv_10.42.42.10(pid=3978): Terminating (SIGTERM) 11:49:55.475294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3979): Terminating (SIGTERM) 11:49:55.520655 run iperf3-srv_10.42.42.10(pid=3980): Terminating (SIGTERM) 11:49:55.563145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3981): Terminating (SIGTERM) 11:49:55.605524 run iperf3-srv_10.42.42.10(pid=3982): Terminating (SIGTERM) 11:49:55.647812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3985): Terminating (SIGTERM) 11:49:55.690854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3988): Terminating (SIGTERM) 11:49:55.734025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3991): Terminating (SIGTERM) 11:49:55.776894 --- ParallelTerminationStrategy: PID 3975 died... 11:49:55.797019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3975): Terminated: ok {rc=0} 11:49:55.844618 --- ParallelTerminationStrategy: PID 3976 died... 11:49:55.864279 run iperf3-srv_10.42.42.10(pid=3976): Terminated {rc=256} 11:49:55.911480 --- ParallelTerminationStrategy: PID 3977 died... 11:49:55.931200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3977): Terminated: ok {rc=0} 11:49:55.978920 --- ParallelTerminationStrategy: PID 3978 died... 11:49:55.998745 run iperf3-srv_10.42.42.10(pid=3978): Terminated {rc=256} 11:49:56.046088 --- ParallelTerminationStrategy: PID 3979 died... 11:49:56.065797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3979): Terminated: ok {rc=0} 11:49:56.113574 --- ParallelTerminationStrategy: PID 3980 died... 11:49:56.133130 run iperf3-srv_10.42.42.10(pid=3980): Terminated {rc=256} 11:49:56.180510 --- ParallelTerminationStrategy: PID 3981 died... 11:49:56.200558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3981): Terminated: ok {rc=0} 11:49:56.247960 --- ParallelTerminationStrategy: PID 3982 died... 11:49:56.267643 run iperf3-srv_10.42.42.10(pid=3982): Terminated {rc=256} 11:49:56.315164 --- ParallelTerminationStrategy: PID 3985 died... 11:49:56.334937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3985): Terminated: ok {rc=0} 11:49:56.382305 --- ParallelTerminationStrategy: PID 3988 died... 11:49:56.402045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3988): Terminated: ok {rc=0} 11:49:56.449618 --- ParallelTerminationStrategy: PID 3991 died... 11:49:56.469355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3991): Terminated: ok {rc=0} 11:49:56.558417 bus /gobi_4: Setting Powered False 11:49:57.658833 bus /gobi_4: Setting Powered False 11:49:58.777947 bus /gobi_1: Setting Powered False 11:49:59.877052 bus /gobi_1: Setting Powered False 11:50:00.996736 bus /gobi_0: Setting Powered False 11:50:02.112378 bus /gobi_0: Setting Powered False 11:50:03.234481 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:50:04.338058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.350322 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:50:04.423611 tst ping.py: using LAC 28191 11:50:04.548650 tst ping.py: using RAC 141 11:50:04.675659 tst ping.py: using CellId 28191 11:50:04.799380 tst ping.py: using BVCI 28192 11:50:04.913861 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.925519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.936813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.948147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.959385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.970639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.981989 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:04.993173 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:05.111374 tst ping.py:19: start network... 11:50:05.324786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:05.812894 run create_hlr_db(pid=3996): Launched 11:50:05.941386 bus /gobi_6: Setting Powered False 11:50:07.004372 run create_hlr_db(pid=3996): Terminated: ok {rc=0} 11:50:07.444303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3998): Launched 11:50:07.760926 run osmo-hlr_10.42.42.2(pid=3999): Launched 11:50:07.881312 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:08.430250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4001): Launched 11:50:08.724381 run osmo-stp_10.42.42.5(pid=4002): Launched 11:50:08.836820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:09.345026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4004): Launched 11:50:09.458407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:09.706327 run patchelf(pid=4005): Launched 11:50:09.869320 run osmo-stp_10.42.42.5(pid=4002): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4002)] 11:50:09.993859 run osmo-stp_10.42.42.5(pid=4002): stdout: | (launched: 2022-12-10_11:50:08.670842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:10.119549 run osmo-stp_10.42.42.5(pid=4002): stderr: | 20221210115008839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115008839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115008839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115008839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115008840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115008840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115008840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:10.245983 run osmo-stp_10.42.42.5(pid=4002): stdout: | (launched: 2022-12-10_11:50:08.670842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:10.366580 run osmo-stp_10.42.42.5(pid=4002): stderr: | 20221210115008839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115008839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115008839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115008839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115008840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115008840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115008840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:10.509406 run patchelf(pid=4005): Terminating (SIGINT) 11:50:10.674429 run patchelf(pid=4005): Terminated: ok {rc=0} 11:50:10.793177 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4002): Process ended prematurely: osmo-stp_10.42.42.5(pid=4002) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4002)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 11:50:10.802038 tst ping.py:22: Test FAILED (6.5 sec) 11:50:10.829219 run osmo-hlr_10.42.42.2(pid=3999): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3999)] 11:50:10.876694 run osmo-hlr_10.42.42.2(pid=3999): stdout: | (launched: 2022-12-10_11:50:07.703308) 11:50:10.926053 run osmo-hlr_10.42.42.2(pid=3999): stderr: | 20221210115007902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115007902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115007902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115007902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115007902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115007903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115007915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115007923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115007924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115007924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:10.976091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3998): Terminating (SIGTERM) 11:50:11.015795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4001): Terminating (SIGTERM) 11:50:11.055363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4004): Terminating (SIGTERM) 11:50:11.095449 --- ParallelTerminationStrategy: PID 3998 died... 11:50:11.114341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3998): Terminated: ok {rc=0} 11:50:11.158938 --- ParallelTerminationStrategy: PID 4001 died... 11:50:11.177356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4001): Terminated: ok {rc=0} 11:50:11.221285 --- ParallelTerminationStrategy: PID 4004 died... 11:50:11.239877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4004): Terminated: ok {rc=0} 11:50:11.325184 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:50:12.413879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:12.425865 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:50:12.496823 tst ping_idle_ping.py: using LAC 28192 11:50:12.612815 tst ping_idle_ping.py: using RAC 142 11:50:12.732117 tst ping_idle_ping.py: using CellId 28192 11:50:12.847047 tst ping_idle_ping.py: using BVCI 28193 11:50:12.953502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:12.964802 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:12.975902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:12.986935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:12.998029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:13.008895 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:13.020074 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:13.030999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:13.147321 tst ping_idle_ping.py:24: start network... 11:50:13.361832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:13.855702 run create_hlr_db(pid=4006): Launched 11:50:13.980181 bus /gobi_6: Setting Powered False 11:50:15.040816 run create_hlr_db(pid=4006): Terminated: ok {rc=0} 11:50:15.473914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4008): Launched 11:50:15.791718 run osmo-hlr_10.42.42.2(pid=4009): Launched 11:50:16.043604 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:16.690564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4011): Launched 11:50:17.058831 run osmo-stp_10.42.42.5(pid=4012): Launched 11:50:17.271848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:17.823189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4014): Launched 11:50:17.943841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:18.210124 run patchelf(pid=4015): Launched 11:50:18.386037 run osmo-stp_10.42.42.5(pid=4012): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4012)] 11:50:18.519573 run osmo-stp_10.42.42.5(pid=4012): stdout: | (launched: 2022-12-10_11:50:16.994907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:18.654913 run osmo-stp_10.42.42.5(pid=4012): stderr: | 20221210115017271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115017271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115017271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115017272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115017274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115017274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115017274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:18.791397 run osmo-stp_10.42.42.5(pid=4012): stdout: | (launched: 2022-12-10_11:50:16.994907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:18.920808 run osmo-stp_10.42.42.5(pid=4012): stderr: | 20221210115017271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115017271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115017271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115017272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115017274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115017274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115017274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:19.075157 run patchelf(pid=4015): Terminating (SIGINT) 11:50:19.252312 run patchelf(pid=4015): Terminated: ok {rc=0} 11:50:19.380260 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4012): Process ended prematurely: osmo-stp_10.42.42.5(pid=4012) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4012)] [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:50:19.389927 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 11:50:19.417713 run osmo-hlr_10.42.42.2(pid=4009): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4009)] 11:50:19.467256 run osmo-hlr_10.42.42.2(pid=4009): stdout: | (launched: 2022-12-10_11:50:15.734474) 11:50:19.518508 run osmo-hlr_10.42.42.2(pid=4009): stderr: | 20221210115015996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115015996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115015996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115015997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115015997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115015997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115016011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115016023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115016023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115016023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:19.570171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4008): Terminating (SIGTERM) 11:50:19.611932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4011): Terminating (SIGTERM) 11:50:19.653337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4014): Terminating (SIGTERM) 11:50:19.695224 --- ParallelTerminationStrategy: PID 4008 died... 11:50:19.715032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4008): Terminated: ok {rc=0} 11:50:19.760525 --- ParallelTerminationStrategy: PID 4011 died... 11:50:19.779818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4011): Terminated: ok {rc=0} 11:50:19.825407 --- ParallelTerminationStrategy: PID 4014 died... 11:50:19.844675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4014): Terminated: ok {rc=0} 11:50:19.932532 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:50:21.245850 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:21.253942 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:50:21.288629 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:50:21.323658 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:50:21.375822 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:50:21.409766 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:50:21.444472 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:50:22.007141 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:50:22.012278 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.023950 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:50:22.093473 tst switch_tch_pdch.py: using LAC 28193 11:50:22.217407 tst switch_tch_pdch.py: using RAC 143 11:50:22.339919 tst switch_tch_pdch.py: using CellId 28193 11:50:22.461759 tst switch_tch_pdch.py: using BVCI 28194 11:50:22.576231 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.587897 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.599428 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.610959 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.622545 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.633977 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.645586 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:22.657079 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:50:22.770316 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:50:22.884157 tst switch_tch_pdch.py:51: start network... 11:50:23.082275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:23.540184 run create_hlr_db(pid=4019): Launched 11:50:23.655087 bus /gobi_6: Setting Powered False 11:50:24.714377 run create_hlr_db(pid=4019): Terminated: ok {rc=0} 11:50:25.148089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4021): Launched 11:50:25.463593 run osmo-hlr_10.42.42.2(pid=4022): Launched 11:50:25.585224 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:26.129311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4024): Launched 11:50:26.443423 run osmo-stp_10.42.42.5(pid=4025): Launched 11:50:26.563784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:27.109176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4028): Launched 11:50:27.230037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:27.496432 run patchelf(pid=4029): Launched 11:50:27.672399 run osmo-stp_10.42.42.5(pid=4025): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4025)] 11:50:27.806273 run osmo-stp_10.42.42.5(pid=4025): stdout: | (launched: 2022-12-10_11:50:26.386179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:27.941350 run osmo-stp_10.42.42.5(pid=4025): stderr: | 20221210115026581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115026581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115026581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115026581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115026582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115026582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115026582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:28.076140 run osmo-stp_10.42.42.5(pid=4025): stdout: | (launched: 2022-12-10_11:50:26.386179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:28.205599 run osmo-stp_10.42.42.5(pid=4025): stderr: | 20221210115026581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115026581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115026581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115026581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115026582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115026582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115026582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:28.358772 run patchelf(pid=4029): Terminating (SIGINT) 11:50:28.535260 run patchelf(pid=4029): Terminated: ok {rc=0} 11:50:28.662044 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4025): Process ended prematurely: osmo-stp_10.42.42.5(pid=4025) [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4025)] [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:50:28.671784 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:50:28.699704 run osmo-hlr_10.42.42.2(pid=4022): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4022)] 11:50:28.749568 run osmo-hlr_10.42.42.2(pid=4022): stdout: | (launched: 2022-12-10_11:50:25.406202) 11:50:28.800816 run osmo-hlr_10.42.42.2(pid=4022): stderr: | 20221210115025606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115025606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115025606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115025606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115025606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115025606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115025618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115025628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115025628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115025628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:28.852449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4021): Terminating (SIGTERM) 11:50:28.893821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4024): Terminating (SIGTERM) 11:50:28.935449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4028): Terminating (SIGTERM) 11:50:28.977157 --- ParallelTerminationStrategy: PID 4021 died... 11:50:28.997052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4021): Terminated: ok {rc=0} 11:50:29.043078 --- ParallelTerminationStrategy: PID 4024 died... 11:50:29.062580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4024): Terminated: ok {rc=0} 11:50:29.108587 --- ParallelTerminationStrategy: PID 4028 died... 11:50:29.128263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4028): Terminated: ok {rc=0} 11:50:29.214830 bus /gobi_0: Setting Powered False 11:50:30.313680 bus /gobi_0: Setting Powered False 11:50:31.432863 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:50:32.691113 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:32.697491 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:50:32.731740 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:50:32.766815 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:50:32.820508 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:50:32.854719 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:50:32.889405 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:50:33.447044 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:50:33.452492 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:33.463887 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:50:33.540586 tst switch_tch_pdch.py: using LAC 28194 11:50:33.662910 tst switch_tch_pdch.py: using RAC 144 11:50:33.785032 tst switch_tch_pdch.py: using CellId 28194 11:50:33.906485 tst switch_tch_pdch.py: using BVCI 28195 11:50:34.021148 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:34.032780 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:34.044175 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:34.055706 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:34.067052 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:34.078314 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:34.089875 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:34.101254 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:50:34.214542 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:50:34.329682 tst switch_tch_pdch.py:51: start network... 11:50:34.528733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:34.961677 run create_hlr_db(pid=4033): Launched 11:50:35.075665 bus /gobi_6: Setting Powered False 11:50:36.139487 run create_hlr_db(pid=4033): Terminated: ok {rc=0} 11:50:36.536288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4035): Launched 11:50:36.833216 run osmo-hlr_10.42.42.2(pid=4036): Launched 11:50:36.946703 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:37.442795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4038): Launched 11:50:37.736833 run osmo-stp_10.42.42.5(pid=4039): Launched 11:50:37.850307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:38.333143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4041): Launched 11:50:38.445906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:38.694271 run patchelf(pid=4042): Launched 11:50:38.858110 run osmo-stp_10.42.42.5(pid=4039): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4039)] 11:50:38.982741 run osmo-stp_10.42.42.5(pid=4039): stdout: | (launched: 2022-12-10_11:50:37.683269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:39.109197 run osmo-stp_10.42.42.5(pid=4039): stderr: | 20221210115037852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115037852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115037852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115037853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115037853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115037853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115037853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:39.235997 run osmo-stp_10.42.42.5(pid=4039): stdout: | (launched: 2022-12-10_11:50:37.683269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:39.356326 run osmo-stp_10.42.42.5(pid=4039): stderr: | 20221210115037852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115037852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115037852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115037853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115037853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115037853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115037853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:39.499750 run patchelf(pid=4042): Terminating (SIGINT) 11:50:39.665094 run patchelf(pid=4042): Terminated: ok {rc=0} 11:50:39.783861 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4039): Process ended prematurely: osmo-stp_10.42.42.5(pid=4039) [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4039)] [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:50:39.792738 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 11:50:39.819738 run osmo-hlr_10.42.42.2(pid=4036): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4036)] 11:50:39.867544 run osmo-hlr_10.42.42.2(pid=4036): stdout: | (launched: 2022-12-10_11:50:36.779273) 11:50:39.917240 run osmo-hlr_10.42.42.2(pid=4036): stderr: | 20221210115036955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115036955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115036955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115036955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115036955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115036955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115036967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115036975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115036976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115036976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:39.967200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4035): Terminating (SIGTERM) 11:50:40.007506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4038): Terminating (SIGTERM) 11:50:40.047532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4041): Terminating (SIGTERM) 11:50:40.087647 --- ParallelTerminationStrategy: PID 4035 died... 11:50:40.106657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4035): Terminated: ok {rc=0} 11:50:40.151055 --- ParallelTerminationStrategy: PID 4038 died... 11:50:40.169627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4038): Terminated: ok {rc=0} 11:50:40.213789 --- ParallelTerminationStrategy: PID 4041 died... 11:50:40.232413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4041): Terminated: ok {rc=0} 11:50:40.318223 bus /gobi_0: Setting Powered False 11:50:41.419150 bus /gobi_0: Setting Powered False 11:50:42.534430 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_sms:trx-umtrx --------------------------------------------------------------------- 11:50:43.783662 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:43.787343 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:50:43.820078 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 11:50:43.826796 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 11:50:43.877723 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:50:43.909501 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 11:50:43.916039 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 11:50:44.453912 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 11:50:44.458745 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 11:50:44.469360 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 11:50:44.515371 tst mo_mt_sms.py: using LAC 28195 11:50:44.631064 tst mo_mt_sms.py: using RAC 145 11:50:44.757307 tst mo_mt_sms.py: using CellId 28195 11:50:44.881398 tst mo_mt_sms.py: using BVCI 28196 11:50:44.994999 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:50:45.110772 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:50:45.227289 tst mo_mt_sms.py:9: start nitb and bts... 11:50:45.442570 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:50:46.114121 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4047): Launched 11:50:46.448726 run osmo-nitb_10.42.42.2(pid=4048): Launched 11:50:46.635238 run osmo-nitb_10.42.42.2(pid=4048): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4048)] 11:50:46.773610 run osmo-nitb_10.42.42.2(pid=4048): stdout: | (launched: 2022-12-10_11:50:46.383918) 11:50:46.913476 run osmo-nitb_10.42.42.2(pid=4048): stderr: | (launched: 2022-12-10_11:50:46.428818) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:50:47.052061 run osmo-nitb_10.42.42.2(pid=4048): stdout: | (launched: 2022-12-10_11:50:46.383918) 11:50:47.185561 run osmo-nitb_10.42.42.2(pid=4048): stderr: | (launched: 2022-12-10_11:50:46.428818) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4048) [trial-2374↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4048)] 11:50:47.582013 tst osmo-nitb_10.42.42.2(pid=4048): stdout: | (launched: 2022-12-10_11:50:46.383918) 11:50:47.701928 tst osmo-nitb_10.42.42.2(pid=4048): stderr: | (launched: 2022-12-10_11:50:46.428818) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:50:47.842925 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4048) [trial-2374↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4048)] [trial-2374↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 11:50:47.851214 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 11:50:47.857719 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4047): Terminating (SIGTERM) 11:50:48.066961 --- ParallelTerminationStrategy: PID 4047 died... 11:50:48.087530 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4047): Terminated: ok {rc=0} 11:50:48.173573 bus /sierra_3: Setting Powered False 11:50:49.274759 bus /sierra_3: Setting Powered False 11:50:50.391597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:trx-umtrx --------------------------------------------------------------------- 11:50:51.586865 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:51.590972 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:50:51.623463 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:50:51.649625 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 11:50:51.700742 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:50:51.733106 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:50:51.758942 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 11:50:52.303913 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 11:50:52.310341 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:50:52.322025 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 11:50:52.370223 tst mo_mt_sms.py: using LAC 28196 11:50:52.493868 tst mo_mt_sms.py: using RAC 146 11:50:52.618129 tst mo_mt_sms.py: using CellId 28196 11:50:52.743798 tst mo_mt_sms.py: using BVCI 28197 11:50:52.850971 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:50:52.861436 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:50:52.871681 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:50:52.882211 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:50:52.895981 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:50:52.907101 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:50:53.023923 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:50:53.138881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:53.594239 run create_hlr_db(pid=4052): Launched 11:50:53.706078 bus /sierra_2: Setting Powered False 11:50:54.765379 run create_hlr_db(pid=4052): Terminated: ok {rc=0} 11:50:55.197180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Launched 11:50:55.512862 run osmo-hlr_10.42.42.2(pid=4055): Launched 11:50:55.636673 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:56.179546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Launched 11:50:56.494857 run osmo-stp_10.42.42.5(pid=4058): Launched 11:50:56.616573 run osmo-msc_10.42.42.6: Starting osmo-msc 11:50:57.188613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Launched 11:50:57.505194 run osmo-msc_10.42.42.6(pid=4061): Launched 11:50:57.682237 run osmo-stp_10.42.42.5(pid=4058): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] 11:50:57.814722 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-10_11:50:56.437604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:57.947832 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221210115056627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115056627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115056627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115056628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115056628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115056628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115056628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:58.080290 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-10_11:50:56.437604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:58.206430 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221210115056627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115056627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115056627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115056628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115056628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115056628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115056628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:58.356681 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4058): Process ended prematurely: osmo-stp_10.42.42.5(pid=4058) [trial-2374↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] [trial-2374↪sms:trx-umtrx↪mo_mt_sms.py:16] 11:50:58.365847 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 11:50:58.393325 run osmo-hlr_10.42.42.2(pid=4055): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4055)] 11:50:58.443253 run osmo-hlr_10.42.42.2(pid=4055): stdout: | (launched: 2022-12-10_11:50:55.455903) 11:50:58.494641 run osmo-hlr_10.42.42.2(pid=4055): stderr: | 20221210115055654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115055654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115055654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115055654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115055654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115055654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115055667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115055675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115055675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115055675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:58.566648 run osmo-msc_10.42.42.6(pid=4061): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4061)] 11:50:58.617172 run osmo-msc_10.42.42.6(pid=4061): stdout: | (launched: 2022-12-10_11:50:57.447690) 11:50:58.668543 run osmo-msc_10.42.42.6(pid=4061): stderr: | 20221210115057770 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115057770 DLGLOBAL DEBUG validating counter group 0x7f6b779b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115057771 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115057771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115057771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115057771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115057773 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115057773 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115057773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115057773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:50:58.720801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminating (SIGTERM) 11:50:58.762646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminating (SIGTERM) 11:50:58.804359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminating (SIGTERM) 11:50:58.846349 --- ParallelTerminationStrategy: PID 4054 died... 11:50:58.865957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminated: ok {rc=0} 11:50:58.912042 --- ParallelTerminationStrategy: PID 4057 died... 11:50:58.931550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminated: ok {rc=0} 11:50:58.977299 --- ParallelTerminationStrategy: PID 4060 died... 11:50:58.996749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminated: ok {rc=0} 11:50:59.085086 bus /sierra_3: Setting Powered False 11:51:00.181855 bus /sierra_3: Setting Powered False 11:51:01.303994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 11:51:02.536240 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:02.540305 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:51:02.573649 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 11:51:02.580539 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 11:51:02.616555 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:51:02.649585 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 11:51:02.656482 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 11:51:03.176382 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 11:51:03.181527 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 11:51:03.192459 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 11:51:03.240668 tst assert_extension.py: using LAC 28197 11:51:03.366649 tst assert_extension.py: using RAC 147 11:51:03.491575 tst assert_extension.py: using CellId 28197 11:51:03.614403 tst assert_extension.py: using BVCI 28198 11:51:03.730291 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 11:51:03.843013 tst assert_extension.py:10: start nitb and bts... 11:51:04.055050 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:51:04.699099 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4066): Launched 11:51:05.015352 run osmo-nitb_10.42.42.2(pid=4067): Launched 11:51:05.190720 run osmo-nitb_10.42.42.2(pid=4067): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] 11:51:05.332222 run osmo-nitb_10.42.42.2(pid=4067): stdout: | (launched: 2022-12-10_11:51:04.957725) 11:51:05.475515 run osmo-nitb_10.42.42.2(pid=4067): stderr: | (launched: 2022-12-10_11:51:05.005002) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:51:05.618737 run osmo-nitb_10.42.42.2(pid=4067): stdout: | (launched: 2022-12-10_11:51:04.957725) 11:51:05.756409 run osmo-nitb_10.42.42.2(pid=4067): stderr: | (launched: 2022-12-10_11:51:05.005002) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4067) [trial-2374↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] 11:51:06.134996 tst osmo-nitb_10.42.42.2(pid=4067): stdout: | (launched: 2022-12-10_11:51:04.957725) 11:51:06.263040 tst osmo-nitb_10.42.42.2(pid=4067): stderr: | (launched: 2022-12-10_11:51:05.005002) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:51:06.414049 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4067) [trial-2374↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] [trial-2374↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 11:51:06.423082 tst assert_extension.py:12: Test FAILED (3.2 sec) 11:51:06.430315 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4066): Terminating (SIGTERM) 11:51:06.640759 --- ParallelTerminationStrategy: PID 4066 died... 11:51:06.662140 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4066): Terminated: ok {rc=0} 11:51:06.750047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:trx-umtrx --------------------------------------------------------------------- 11:51:07.927753 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:07.932754 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:51:07.966133 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:51:07.993175 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 11:51:08.031278 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:51:08.064708 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:51:08.091049 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 11:51:08.617307 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 11:51:08.623226 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:51:08.634390 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 11:51:08.682351 tst assert_extension.py: using LAC 28198 11:51:08.808928 tst assert_extension.py: using RAC 148 11:51:08.933916 tst assert_extension.py: using CellId 28198 11:51:09.058906 tst assert_extension.py: using BVCI 28199 11:51:09.173199 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:51:09.184106 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:51:09.194959 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:51:09.205714 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:51:09.216498 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:51:09.227214 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 11:51:09.340545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:09.797580 run create_hlr_db(pid=4071): Launched 11:51:09.912108 bus /sierra_2: Setting Powered False 11:51:10.971720 run create_hlr_db(pid=4071): Terminated: ok {rc=0} 11:51:11.403838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4073): Launched 11:51:11.721124 run osmo-hlr_10.42.42.2(pid=4074): Launched 11:51:11.842874 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:12.391255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4076): Launched 11:51:12.706838 run osmo-stp_10.42.42.5(pid=4077): Launched 11:51:12.827592 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:13.397990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4079): Launched 11:51:13.713803 run osmo-msc_10.42.42.6(pid=4080): Launched 11:51:13.889964 run osmo-stp_10.42.42.5(pid=4077): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4077)] 11:51:14.022787 run osmo-stp_10.42.42.5(pid=4077): stdout: | (launched: 2022-12-10_11:51:12.649185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:14.155864 run osmo-stp_10.42.42.5(pid=4077): stderr: | 20221210115112839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115112839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115112839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115112840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115112840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115112840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115112840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:14.288473 run osmo-stp_10.42.42.5(pid=4077): stdout: | (launched: 2022-12-10_11:51:12.649185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:14.415075 run osmo-stp_10.42.42.5(pid=4077): stderr: | 20221210115112839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115112839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115112839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115112840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115112840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115112840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115112840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:14.565546 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4077): Process ended prematurely: osmo-stp_10.42.42.5(pid=4077) [trial-2374↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4077)] [trial-2374↪ussd:trx-umtrx↪assert_extension.py:17] 11:51:14.574273 tst assert_extension.py:17: Test FAILED (5.9 sec) 11:51:14.601596 run osmo-hlr_10.42.42.2(pid=4074): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4074)] 11:51:14.651198 run osmo-hlr_10.42.42.2(pid=4074): stdout: | (launched: 2022-12-10_11:51:11.663424) 11:51:14.702760 run osmo-hlr_10.42.42.2(pid=4074): stderr: | 20221210115111862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115111862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115111862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115111862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115111862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115111862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115111877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115111885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115111886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115111886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:14.774479 run osmo-msc_10.42.42.6(pid=4080): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4080)] 11:51:14.824028 run osmo-msc_10.42.42.6(pid=4080): stdout: | (launched: 2022-12-10_11:51:13.655977) 11:51:14.875060 run osmo-msc_10.42.42.6(pid=4080): stderr: | 20221210115113976 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115113976 DLGLOBAL DEBUG validating counter group 0x7fd756569c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115113976 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115113976 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115113976 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115113976 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115113978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115113978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115113979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115113979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:14.926570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4073): Terminating (SIGTERM) 11:51:14.967751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4076): Terminating (SIGTERM) 11:51:15.010199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4079): Terminating (SIGTERM) 11:51:15.051952 --- ParallelTerminationStrategy: PID 4073 died... 11:51:15.071431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4073): Terminated: ok {rc=0} 11:51:15.117197 --- ParallelTerminationStrategy: PID 4076 died... 11:51:15.136487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4076): Terminated: ok {rc=0} 11:51:15.182096 --- ParallelTerminationStrategy: PID 4079 died... 11:51:15.201619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4079): Terminated: ok {rc=0} 11:51:15.287904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:51:16.516870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:16.528022 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:51:16.571523 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:51:16.607384 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:51:16.672719 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:51:16.707873 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:51:16.735770 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:51:17.283397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:51:17.334596 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:17.345830 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:51:17.414865 tst mo_mt_call.py: using LAC 28199 11:51:17.534324 tst mo_mt_call.py: using RAC 149 11:51:17.652115 tst mo_mt_call.py: using CellId 28199 11:51:17.770791 tst mo_mt_call.py: using BVCI 28200 11:51:17.880712 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:17.891945 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:17.902781 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:17.913779 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:17.924841 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:17.935804 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:18.052776 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:18.169539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:18.634619 run create_hlr_db(pid=4085): Launched 11:51:18.749261 bus /sierra_2: Setting Powered False 11:51:19.809141 run create_hlr_db(pid=4085): Terminated: ok {rc=0} 11:51:20.227709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4087): Launched 11:51:20.528189 run osmo-hlr_10.42.42.2(pid=4088): Launched 11:51:20.643217 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:21.172244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4090): Launched 11:51:21.471646 run osmo-stp_10.42.42.5(pid=4091): Launched 11:51:21.587032 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:22.129862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4093): Launched 11:51:22.430308 run osmo-msc_10.42.42.6(pid=4094): Launched 11:51:22.597998 run osmo-stp_10.42.42.5(pid=4091): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4091)] 11:51:22.725266 run osmo-stp_10.42.42.5(pid=4091): stdout: | (launched: 2022-12-10_11:51:21.417321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:22.852496 run osmo-stp_10.42.42.5(pid=4091): stderr: | 20221210115121589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115121589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115121589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115121590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115121590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115121590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115121590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:22.977239 run osmo-stp_10.42.42.5(pid=4091): stdout: | (launched: 2022-12-10_11:51:21.417321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:23.096634 run osmo-stp_10.42.42.5(pid=4091): stderr: | 20221210115121589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115121589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115121589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115121590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115121590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115121590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115121590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:23.239706 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4091): Process ended prematurely: osmo-stp_10.42.42.5(pid=4091) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4091)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:51:23.248598 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:51:23.275136 run osmo-hlr_10.42.42.2(pid=4088): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4088)] 11:51:23.322702 run osmo-hlr_10.42.42.2(pid=4088): stdout: | (launched: 2022-12-10_11:51:20.473620) 11:51:23.371863 run osmo-hlr_10.42.42.2(pid=4088): stderr: | 20221210115120647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115120647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115120647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115120647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115120647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115120647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115120662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115120672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115120672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115120672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:23.440129 run osmo-msc_10.42.42.6(pid=4094): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4094)] 11:51:23.487865 run osmo-msc_10.42.42.6(pid=4094): stdout: | (launched: 2022-12-10_11:51:22.375401) 11:51:23.537088 run osmo-msc_10.42.42.6(pid=4094): stderr: | 20221210115122648 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115122649 DLGLOBAL DEBUG validating counter group 0x7f10d9826c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115122649 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115122649 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115122649 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115122650 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115122651 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115122652 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115122652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115122652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:23.586630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4087): Terminating (SIGTERM) 11:51:23.626130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4090): Terminating (SIGTERM) 11:51:23.665619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4093): Terminating (SIGTERM) 11:51:23.705319 --- ParallelTerminationStrategy: PID 4087 died... 11:51:23.723945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4087): Terminated: ok {rc=0} 11:51:23.767696 --- ParallelTerminationStrategy: PID 4090 died... 11:51:23.785900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4090): Terminated: ok {rc=0} 11:51:23.830121 --- ParallelTerminationStrategy: PID 4093 died... 11:51:23.848587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4093): Terminated: ok {rc=0} 11:51:23.935224 bus /sierra_3: Setting Powered False 11:51:25.035961 bus /sierra_3: Setting Powered False 11:51:26.153165 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:51:27.299544 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:27.311109 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:51:27.379622 tst mo_mt_call_osmux.py: using LAC 28200 11:51:27.497960 tst mo_mt_call_osmux.py: using RAC 150 11:51:27.617424 tst mo_mt_call_osmux.py: using CellId 28200 11:51:27.734685 tst mo_mt_call_osmux.py: using BVCI 28201 11:51:27.844438 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:27.855501 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:27.866402 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:27.877477 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:27.888523 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:27.899624 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:28.013591 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:28.132740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:28.630114 run create_hlr_db(pid=4096): Launched 11:51:28.761896 bus /sierra_2: Setting Powered False 11:51:29.826053 run create_hlr_db(pid=4096): Terminated: ok {rc=0} 11:51:30.257199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4098): Launched 11:51:30.558196 run osmo-hlr_10.42.42.2(pid=4099): Launched 11:51:30.672164 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:31.204022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4101): Launched 11:51:31.527006 run osmo-stp_10.42.42.5(pid=4102): Launched 11:51:31.805225 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:32.430642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4104): Launched 11:51:32.753572 run osmo-msc_10.42.42.6(pid=4105): Launched 11:51:32.933477 run osmo-stp_10.42.42.5(pid=4102): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4102)] 11:51:33.069817 run osmo-stp_10.42.42.5(pid=4102): stdout: | (launched: 2022-12-10_11:51:31.465635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:33.205720 run osmo-stp_10.42.42.5(pid=4102): stderr: | 20221210115131695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115131695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115131695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115131695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115131697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115131697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115131697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:33.340772 run osmo-stp_10.42.42.5(pid=4102): stdout: | (launched: 2022-12-10_11:51:31.465635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:33.469310 run osmo-stp_10.42.42.5(pid=4102): stderr: | 20221210115131695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115131695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115131695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115131695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115131697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115131697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115131697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:33.623057 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4102): Process ended prematurely: osmo-stp_10.42.42.5(pid=4102) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4102)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:51:33.632657 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:51:33.660770 run osmo-hlr_10.42.42.2(pid=4099): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4099)] 11:51:33.711624 run osmo-hlr_10.42.42.2(pid=4099): stdout: | (launched: 2022-12-10_11:51:30.503264) 11:51:33.763890 run osmo-hlr_10.42.42.2(pid=4099): stderr: | 20221210115130680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115130680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115130680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115130680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115130680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115130680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115130693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115130703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115130703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115130703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:33.836552 run osmo-msc_10.42.42.6(pid=4105): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4105)] 11:51:33.886857 run osmo-msc_10.42.42.6(pid=4105): stdout: | (launched: 2022-12-10_11:51:32.694781) 11:51:33.938571 run osmo-msc_10.42.42.6(pid=4105): stderr: | 20221210115133018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115133018 DLGLOBAL DEBUG validating counter group 0x7faa9f2aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115133018 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115133018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115133018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115133018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115133020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115133020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115133021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115133021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:33.990683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4098): Terminating (SIGTERM) 11:51:34.032301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4101): Terminating (SIGTERM) 11:51:34.074150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4104): Terminating (SIGTERM) 11:51:34.116233 --- ParallelTerminationStrategy: PID 4098 died... 11:51:34.136432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4098): Terminated: ok {rc=0} 11:51:34.183389 --- ParallelTerminationStrategy: PID 4101 died... 11:51:34.203124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4101): Terminated: ok {rc=0} 11:51:34.249425 --- ParallelTerminationStrategy: PID 4104 died... 11:51:34.269159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4104): Terminated: ok {rc=0} 11:51:34.358196 bus /sierra_3: Setting Powered False 11:51:35.454862 bus /sierra_3: Setting Powered False 11:51:36.570828 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:51:37.818748 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:37.825124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:51:37.857694 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:51:37.883988 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:51:37.934663 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:51:37.966680 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:51:37.993133 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:51:38.544106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:51:38.592663 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:38.603692 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:51:38.671462 tst mo_mt_call.py: using LAC 28201 11:51:38.790515 tst mo_mt_call.py: using RAC 151 11:51:38.910039 tst mo_mt_call.py: using CellId 28201 11:51:39.028119 tst mo_mt_call.py: using BVCI 28202 11:51:39.146921 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:39.158686 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:39.170147 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:39.181986 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:39.193672 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:39.205283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:51:39.319810 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:51:39.437936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:39.936677 run create_hlr_db(pid=4110): Launched 11:51:40.067525 bus /sierra_2: Setting Powered False 11:51:41.132353 run create_hlr_db(pid=4110): Terminated: ok {rc=0} 11:51:41.561090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4112): Launched 11:51:41.861514 run osmo-hlr_10.42.42.2(pid=4113): Launched 11:51:41.975565 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:42.505424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4115): Launched 11:51:42.804567 run osmo-stp_10.42.42.5(pid=4116): Launched 11:51:42.918802 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:43.461317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4118): Launched 11:51:43.762125 run osmo-msc_10.42.42.6(pid=4119): Launched 11:51:43.930266 run osmo-stp_10.42.42.5(pid=4116): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4116)] 11:51:44.058125 run osmo-stp_10.42.42.5(pid=4116): stdout: | (launched: 2022-12-10_11:51:42.749794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:44.185593 run osmo-stp_10.42.42.5(pid=4116): stderr: | 20221210115142920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115142921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115142921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115142921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115142922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115142922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115142922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:44.310469 run osmo-stp_10.42.42.5(pid=4116): stdout: | (launched: 2022-12-10_11:51:42.749794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:44.430350 run osmo-stp_10.42.42.5(pid=4116): stderr: | 20221210115142920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115142921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115142921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115142921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115142922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115142922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115142922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:44.574050 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4116): Process ended prematurely: osmo-stp_10.42.42.5(pid=4116) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4116)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:51:44.582820 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:51:44.609584 run osmo-hlr_10.42.42.2(pid=4113): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4113)] 11:51:44.657552 run osmo-hlr_10.42.42.2(pid=4113): stdout: | (launched: 2022-12-10_11:51:41.806878) 11:51:44.706975 run osmo-hlr_10.42.42.2(pid=4113): stderr: | 20221210115141981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115141981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115141981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115141981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115141981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115141981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115141992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115142001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115142001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115142001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:44.775914 run osmo-msc_10.42.42.6(pid=4119): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4119)] 11:51:44.823728 run osmo-msc_10.42.42.6(pid=4119): stdout: | (launched: 2022-12-10_11:51:43.706944) 11:51:44.873107 run osmo-msc_10.42.42.6(pid=4119): stderr: | 20221210115143978 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115143978 DLGLOBAL DEBUG validating counter group 0x7f305e8aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115143978 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115143978 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115143978 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115143978 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115143982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115143983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115143983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115143983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:44.922628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4112): Terminating (SIGTERM) 11:51:44.961944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4115): Terminating (SIGTERM) 11:51:45.001526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4118): Terminating (SIGTERM) 11:51:45.041649 --- ParallelTerminationStrategy: PID 4112 died... 11:51:45.060391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4112): Terminated: ok {rc=0} 11:51:45.105053 --- ParallelTerminationStrategy: PID 4115 died... 11:51:45.123423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4115): Terminated: ok {rc=0} 11:51:45.167346 --- ParallelTerminationStrategy: PID 4118 died... 11:51:45.185822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4118): Terminated: ok {rc=0} 11:51:45.272420 bus /sierra_3: Setting Powered False 11:51:46.374022 bus /sierra_3: Setting Powered False 11:51:47.494992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:51:48.643474 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:48.655223 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:51:48.724038 tst mo_mt_call_osmux.py: using LAC 28202 11:51:48.855434 tst mo_mt_call_osmux.py: using RAC 152 11:51:48.981552 tst mo_mt_call_osmux.py: using CellId 28202 11:51:49.105335 tst mo_mt_call_osmux.py: using BVCI 28203 11:51:49.221748 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:49.233490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:49.244905 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:49.256194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:49.267520 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:51:49.278811 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:51:49.394936 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:51:49.513348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:49.981659 run create_hlr_db(pid=4121): Launched 11:51:50.097536 bus /sierra_2: Setting Powered False 11:51:51.158200 run create_hlr_db(pid=4121): Terminated: ok {rc=0} 11:51:51.597171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4123): Launched 11:51:51.920588 run osmo-hlr_10.42.42.2(pid=4124): Launched 11:51:52.043819 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:52.601457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4126): Launched 11:51:52.923839 run osmo-stp_10.42.42.5(pid=4127): Launched 11:51:53.046737 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:53.627565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4129): Launched 11:51:53.949710 run osmo-msc_10.42.42.6(pid=4130): Launched 11:51:54.128706 run osmo-stp_10.42.42.5(pid=4127): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4127)] 11:51:54.263631 run osmo-stp_10.42.42.5(pid=4127): stdout: | (launched: 2022-12-10_11:51:52.865695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:54.399330 run osmo-stp_10.42.42.5(pid=4127): stderr: | 20221210115153057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115153057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115153057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115153058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115153058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115153058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115153058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:54.534149 run osmo-stp_10.42.42.5(pid=4127): stdout: | (launched: 2022-12-10_11:51:52.865695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:54.662261 run osmo-stp_10.42.42.5(pid=4127): stderr: | 20221210115153057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115153057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115153057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115153058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115153058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115153058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115153058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:54.816047 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4127): Process ended prematurely: osmo-stp_10.42.42.5(pid=4127) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4127)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:51:54.825745 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:51:54.853421 run osmo-hlr_10.42.42.2(pid=4124): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4124)] 11:51:54.903211 run osmo-hlr_10.42.42.2(pid=4124): stdout: | (launched: 2022-12-10_11:51:51.862007) 11:51:54.954573 run osmo-hlr_10.42.42.2(pid=4124): stderr: | 20221210115152058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115152058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115152058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115152058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115152058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115152058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115152071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115152079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115152079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115152079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:55.025957 run osmo-msc_10.42.42.6(pid=4130): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4130)] 11:51:55.075678 run osmo-msc_10.42.42.6(pid=4130): stdout: | (launched: 2022-12-10_11:51:53.891547) 11:51:55.126768 run osmo-msc_10.42.42.6(pid=4130): stderr: | 20221210115154211 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115154211 DLGLOBAL DEBUG validating counter group 0x7f0e292dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115154212 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115154212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115154212 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115154212 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115154214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115154214 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115154214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115154214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:55.178064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4123): Terminating (SIGTERM) 11:51:55.219200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4126): Terminating (SIGTERM) 11:51:55.260515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4129): Terminating (SIGTERM) 11:51:55.302032 --- ParallelTerminationStrategy: PID 4123 died... 11:51:55.321677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4123): Terminated: ok {rc=0} 11:51:55.367276 --- ParallelTerminationStrategy: PID 4126 died... 11:51:55.386669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4126): Terminated: ok {rc=0} 11:51:55.432104 --- ParallelTerminationStrategy: PID 4129 died... 11:51:55.451545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4129): Terminated: ok {rc=0} 11:51:55.537811 bus /sierra_3: Setting Powered False 11:51:56.635892 bus /sierra_3: Setting Powered False 11:51:57.751383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:51:58.996124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:59.002474 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:51:59.034931 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:51:59.061204 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:51:59.112807 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:51:59.144930 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:51:59.171193 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:51:59.720453 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:51:59.769230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:51:59.780603 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:51:59.848185 tst mo_mt_call.py: using LAC 28203 11:51:59.967367 tst mo_mt_call.py: using RAC 153 11:52:00.087188 tst mo_mt_call.py: using CellId 28203 11:52:00.204659 tst mo_mt_call.py: using BVCI 28204 11:52:00.313479 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:00.324573 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:00.335542 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:00.346866 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:00.358178 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:00.369366 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:00.485485 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:00.601316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:01.099974 run create_hlr_db(pid=4135): Launched 11:52:01.252790 bus /sierra_2: Setting Powered False 11:52:02.311324 run create_hlr_db(pid=4135): Terminated: ok {rc=0} 11:52:02.738097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4137): Launched 11:52:03.038964 run osmo-hlr_10.42.42.2(pid=4138): Launched 11:52:03.153838 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:03.685778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4140): Launched 11:52:03.987560 run osmo-stp_10.42.42.5(pid=4141): Launched 11:52:04.102724 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:04.647205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4143): Launched 11:52:04.950069 run osmo-msc_10.42.42.6(pid=4144): Launched 11:52:05.119476 run osmo-stp_10.42.42.5(pid=4141): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4141)] 11:52:05.247217 run osmo-stp_10.42.42.5(pid=4141): stdout: | (launched: 2022-12-10_11:52:03.932616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:05.374685 run osmo-stp_10.42.42.5(pid=4141): stderr: | 20221210115204104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115204104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115204104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115204105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115204105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115204105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115204106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:05.500254 run osmo-stp_10.42.42.5(pid=4141): stdout: | (launched: 2022-12-10_11:52:03.932616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:05.620321 run osmo-stp_10.42.42.5(pid=4141): stderr: | 20221210115204104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115204104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115204104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115204105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115204105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115204105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115204106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:05.764199 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4141): Process ended prematurely: osmo-stp_10.42.42.5(pid=4141) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4141)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:52:05.773239 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:52:05.800005 run osmo-hlr_10.42.42.2(pid=4138): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4138)] 11:52:05.847962 run osmo-hlr_10.42.42.2(pid=4138): stdout: | (launched: 2022-12-10_11:52:02.984339) 11:52:05.897451 run osmo-hlr_10.42.42.2(pid=4138): stderr: | 20221210115203159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115203159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115203159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115203159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115203159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115203159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115203171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115203179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115203179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115203180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:05.966100 run osmo-msc_10.42.42.6(pid=4144): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4144)] 11:52:06.013799 run osmo-msc_10.42.42.6(pid=4144): stdout: | (launched: 2022-12-10_11:52:04.895408) 11:52:06.063142 run osmo-msc_10.42.42.6(pid=4144): stderr: | 20221210115205166 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115205166 DLGLOBAL DEBUG validating counter group 0x7fcfb01a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115205166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115205167 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115205167 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115205167 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115205169 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115205169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115205169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115205169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:06.112844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4137): Terminating (SIGTERM) 11:52:06.152682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4140): Terminating (SIGTERM) 11:52:06.192724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4143): Terminating (SIGTERM) 11:52:06.232907 --- ParallelTerminationStrategy: PID 4137 died... 11:52:06.251963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4137): Terminated: ok {rc=0} 11:52:06.296598 --- ParallelTerminationStrategy: PID 4140 died... 11:52:06.315663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4140): Terminated: ok {rc=0} 11:52:06.359737 --- ParallelTerminationStrategy: PID 4143 died... 11:52:06.378172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4143): Terminated: ok {rc=0} 11:52:06.461503 bus /sierra_3: Setting Powered False 11:52:07.559278 bus /sierra_3: Setting Powered False 11:52:08.675989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:52:09.826012 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:09.838202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:52:09.913487 tst mo_mt_call_osmux.py: using LAC 28204 11:52:10.038427 tst mo_mt_call_osmux.py: using RAC 154 11:52:10.162389 tst mo_mt_call_osmux.py: using CellId 28204 11:52:10.286378 tst mo_mt_call_osmux.py: using BVCI 28205 11:52:10.402764 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:10.414282 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:10.425603 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:10.436910 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:10.448365 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:10.459658 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:10.577831 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:10.698705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:11.198478 run create_hlr_db(pid=4146): Launched 11:52:11.330083 bus /sierra_2: Setting Powered False 11:52:12.394386 run create_hlr_db(pid=4146): Terminated: ok {rc=0} 11:52:12.824363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4148): Launched 11:52:13.126604 run osmo-hlr_10.42.42.2(pid=4149): Launched 11:52:13.241158 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:13.757724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4151): Launched 11:52:14.058469 run osmo-stp_10.42.42.5(pid=4152): Launched 11:52:14.172817 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:14.716006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4154): Launched 11:52:15.017077 run osmo-msc_10.42.42.6(pid=4155): Launched 11:52:15.186294 run osmo-stp_10.42.42.5(pid=4152): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4152)] 11:52:15.314274 run osmo-stp_10.42.42.5(pid=4152): stdout: | (launched: 2022-12-10_11:52:14.003858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:15.441797 run osmo-stp_10.42.42.5(pid=4152): stderr: | 20221210115214173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115214174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115214174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115214174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115214175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115214175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115214175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:15.566967 run osmo-stp_10.42.42.5(pid=4152): stdout: | (launched: 2022-12-10_11:52:14.003858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:15.686932 run osmo-stp_10.42.42.5(pid=4152): stderr: | 20221210115214173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115214174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115214174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115214174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115214175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115214175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115214175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:15.832086 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4152): Process ended prematurely: osmo-stp_10.42.42.5(pid=4152) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4152)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:52:15.842353 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:52:15.870769 run osmo-hlr_10.42.42.2(pid=4149): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4149)] 11:52:15.938370 run osmo-hlr_10.42.42.2(pid=4149): stdout: | (launched: 2022-12-10_11:52:13.071611) 11:52:15.989619 run osmo-hlr_10.42.42.2(pid=4149): stderr: | 20221210115213251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115213251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115213251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115213251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115213251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115213251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115213264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115213273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115213274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115213274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:16.066340 run osmo-msc_10.42.42.6(pid=4155): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4155)] 11:52:16.116256 run osmo-msc_10.42.42.6(pid=4155): stdout: | (launched: 2022-12-10_11:52:14.962407) 11:52:16.168106 run osmo-msc_10.42.42.6(pid=4155): stderr: | 20221210115215231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115215231 DLGLOBAL DEBUG validating counter group 0x7f107cce0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115215231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115215231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115215232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115215232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115215234 DMNCC DEBUG[1;39m Using internal MNCC handler. (msc_main.c:678) | 20221210115215234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115215234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115215234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:16.220557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4148): Terminating (SIGTERM) 11:52:16.262828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4151): Terminating (SIGTERM) 11:52:16.306245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4154): Terminating (SIGTERM) 11:52:16.348700 --- ParallelTerminationStrategy: PID 4148 died... 11:52:16.368434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4148): Terminated: ok {rc=0} 11:52:16.415639 --- ParallelTerminationStrategy: PID 4151 died... 11:52:16.437292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4151): Terminated: ok {rc=0} 11:52:16.484325 --- ParallelTerminationStrategy: PID 4154 died... 11:52:16.503822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4154): Terminated: ok {rc=0} 11:52:16.590521 bus /sierra_3: Setting Powered False 11:52:17.689029 bus /sierra_3: Setting Powered False 11:52:18.804840 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:52:20.055100 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:52:20.062055 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:52:20.095090 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:52:20.122061 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:52:20.175292 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:52:20.208906 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:52:20.236082 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:52:20.786017 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:52:20.836233 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:20.847470 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:52:20.915625 tst mo_mt_call.py: using LAC 28205 11:52:21.034365 tst mo_mt_call.py: using RAC 155 11:52:21.153898 tst mo_mt_call.py: using CellId 28205 11:52:21.272875 tst mo_mt_call.py: using BVCI 28206 11:52:21.387372 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:21.398579 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:21.409633 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:21.420426 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:21.431654 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:21.442576 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:52:21.558175 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:52:21.675096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:22.141115 run create_hlr_db(pid=4160): Launched 11:52:22.256736 bus /sierra_2: Setting Powered False 11:52:23.321030 run create_hlr_db(pid=4160): Terminated: ok {rc=0} 11:52:23.750537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4162): Launched 11:52:24.052177 run osmo-hlr_10.42.42.2(pid=4163): Launched 11:52:24.167871 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:24.698306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4165): Launched 11:52:24.998625 run osmo-stp_10.42.42.5(pid=4166): Launched 11:52:25.114409 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:25.658226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4168): Launched 11:52:25.958074 run osmo-msc_10.42.42.6(pid=4169): Launched 11:52:26.127034 run osmo-stp_10.42.42.5(pid=4166): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4166)] 11:52:26.253684 run osmo-stp_10.42.42.5(pid=4166): stdout: | (launched: 2022-12-10_11:52:24.943605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:26.380806 run osmo-stp_10.42.42.5(pid=4166): stderr: | 20221210115225115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115225115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115225115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115225115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115225116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115225116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115225116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:26.505213 run osmo-stp_10.42.42.5(pid=4166): stdout: | (launched: 2022-12-10_11:52:24.943605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:26.624631 run osmo-stp_10.42.42.5(pid=4166): stderr: | 20221210115225115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115225115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115225115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115225115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115225116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115225116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115225116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:26.768058 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4166): Process ended prematurely: osmo-stp_10.42.42.5(pid=4166) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4166)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:52:26.777038 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:52:26.803599 run osmo-hlr_10.42.42.2(pid=4163): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4163)] 11:52:26.851520 run osmo-hlr_10.42.42.2(pid=4163): stdout: | (launched: 2022-12-10_11:52:23.996593) 11:52:26.900504 run osmo-hlr_10.42.42.2(pid=4163): stderr: | 20221210115224174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115224174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115224174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115224174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115224174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115224174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115224186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115224195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115224195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115224195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:26.968608 run osmo-msc_10.42.42.6(pid=4169): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4169)] 11:52:27.015955 run osmo-msc_10.42.42.6(pid=4169): stdout: | (launched: 2022-12-10_11:52:25.903360) 11:52:27.065061 run osmo-msc_10.42.42.6(pid=4169): stderr: | 20221210115226175 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115226175 DLGLOBAL DEBUG validating counter group 0x7f98e1249c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115226175 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115226175 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115226175 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115226176 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115226178 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115226178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115226179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115226179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:27.114723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4162): Terminating (SIGTERM) 11:52:27.154330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4165): Terminating (SIGTERM) 11:52:27.193906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4168): Terminating (SIGTERM) 11:52:27.233513 --- ParallelTerminationStrategy: PID 4162 died... 11:52:27.252330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4162): Terminated: ok {rc=0} 11:52:27.296468 --- ParallelTerminationStrategy: PID 4165 died... 11:52:27.315089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4165): Terminated: ok {rc=0} 11:52:27.359092 --- ParallelTerminationStrategy: PID 4168 died... 11:52:27.377613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4168): Terminated: ok {rc=0} 11:52:27.463828 bus /sierra_3: Setting Powered False 11:52:28.563844 bus /sierra_3: Setting Powered False 11:52:29.680292 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:52:30.832345 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:30.847480 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:52:30.935982 tst mo_mt_call_osmux.py: using LAC 28206 11:52:31.062479 tst mo_mt_call_osmux.py: using RAC 156 11:52:31.193149 tst mo_mt_call_osmux.py: using CellId 28206 11:52:31.359363 tst mo_mt_call_osmux.py: using BVCI 28207 11:52:31.515157 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:31.530747 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:31.546716 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:31.562203 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:31.578188 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:31.592436 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:52:31.741425 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:52:31.868933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:32.416149 run create_hlr_db(pid=4171): Launched 11:52:32.532890 bus /sierra_2: Setting Powered False 11:52:33.593301 run create_hlr_db(pid=4171): Terminated: ok {rc=0} 11:52:34.011698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4173): Launched 11:52:34.312791 run osmo-hlr_10.42.42.2(pid=4174): Launched 11:52:34.428568 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:34.948689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4176): Launched 11:52:35.248912 run osmo-stp_10.42.42.5(pid=4177): Launched 11:52:35.363969 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:35.907087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4179): Launched 11:52:36.212019 run osmo-msc_10.42.42.6(pid=4182): Launched 11:52:36.380612 run osmo-stp_10.42.42.5(pid=4177): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4177)] 11:52:36.509086 run osmo-stp_10.42.42.5(pid=4177): stdout: | (launched: 2022-12-10_11:52:35.194125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:36.637098 run osmo-stp_10.42.42.5(pid=4177): stderr: | 20221210115235365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115235365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115235366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115235366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115235367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115235367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115235367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:36.762244 run osmo-stp_10.42.42.5(pid=4177): stdout: | (launched: 2022-12-10_11:52:35.194125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:36.882426 run osmo-stp_10.42.42.5(pid=4177): stderr: | 20221210115235365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115235365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115235366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115235366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115235367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115235367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115235367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:37.026637 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4177): Process ended prematurely: osmo-stp_10.42.42.5(pid=4177) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4177)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:52:37.035481 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:52:37.062474 run osmo-hlr_10.42.42.2(pid=4174): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4174)] 11:52:37.110414 run osmo-hlr_10.42.42.2(pid=4174): stdout: | (launched: 2022-12-10_11:52:34.257870) 11:52:37.160123 run osmo-hlr_10.42.42.2(pid=4174): stderr: | 20221210115234432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115234432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115234432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115234432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115234432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115234433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115234447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115234458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115234458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115234458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:37.229389 run osmo-msc_10.42.42.6(pid=4182): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4182)] 11:52:37.277292 run osmo-msc_10.42.42.6(pid=4182): stdout: | (launched: 2022-12-10_11:52:36.157353) 11:52:37.326567 run osmo-msc_10.42.42.6(pid=4182): stderr: | 20221210115236429 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115236430 DLGLOBAL DEBUG validating counter group 0x7fddc9262c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115236430 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115236430 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115236430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115236430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115236432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115236433 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115236433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115236433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:37.376314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4173): Terminating (SIGTERM) 11:52:37.415847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4176): Terminating (SIGTERM) 11:52:37.455469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4179): Terminating (SIGTERM) 11:52:37.495206 --- ParallelTerminationStrategy: PID 4173 died... 11:52:37.514181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4173): Terminated: ok {rc=0} 11:52:37.558099 --- ParallelTerminationStrategy: PID 4176 died... 11:52:37.576521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4176): Terminated: ok {rc=0} 11:52:37.620688 --- ParallelTerminationStrategy: PID 4179 died... 11:52:37.639186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4179): Terminated: ok {rc=0} 11:52:37.723727 bus /sierra_3: Setting Powered False 11:52:38.822536 bus /sierra_3: Setting Powered False 11:52:39.938443 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:52:41.192179 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:52:41.199902 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:52:41.233626 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:52:41.259690 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:52:41.312176 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:52:41.344357 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:52:41.370636 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:52:41.919453 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:52:41.967991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:41.978972 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:52:42.045464 tst mo_mt_call.py: using LAC 28207 11:52:42.174475 tst mo_mt_call.py: using RAC 157 11:52:42.301697 tst mo_mt_call.py: using CellId 28207 11:52:42.428839 tst mo_mt_call.py: using BVCI 28208 11:52:42.545174 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:42.556471 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:42.567736 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:42.578980 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:42.590319 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:42.601553 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:52:42.715710 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:52:42.832570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:43.330540 run create_hlr_db(pid=4187): Launched 11:52:43.461603 bus /sierra_2: Setting Powered False 11:52:44.525536 run create_hlr_db(pid=4187): Terminated: ok {rc=0} 11:52:44.955027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Launched 11:52:45.256123 run osmo-hlr_10.42.42.2(pid=4190): Launched 11:52:45.371499 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:45.913562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Launched 11:52:46.262013 run osmo-stp_10.42.42.5(pid=4193): Launched 11:52:46.515615 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:47.401777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4195): Launched 11:52:47.702839 run osmo-msc_10.42.42.6(pid=4196): Launched 11:52:47.870500 run osmo-stp_10.42.42.5(pid=4193): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] 11:52:47.997190 run osmo-stp_10.42.42.5(pid=4193): stdout: | (launched: 2022-12-10_11:52:46.195509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:48.123699 run osmo-stp_10.42.42.5(pid=4193): stderr: | 20221210115246619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115246620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115246622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115246623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115246624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115246624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115246624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:48.248627 run osmo-stp_10.42.42.5(pid=4193): stdout: | (launched: 2022-12-10_11:52:46.195509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:48.368448 run osmo-stp_10.42.42.5(pid=4193): stderr: | 20221210115246619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115246620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115246622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115246623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115246624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115246624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115246624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:48.511331 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4193): Process ended prematurely: osmo-stp_10.42.42.5(pid=4193) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:52:48.520429 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 11:52:48.547322 run osmo-hlr_10.42.42.2(pid=4190): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4190)] 11:52:48.594977 run osmo-hlr_10.42.42.2(pid=4190): stdout: | (launched: 2022-12-10_11:52:45.200670) 11:52:48.644204 run osmo-hlr_10.42.42.2(pid=4190): stderr: | 20221210115245379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115245379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115245379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115245379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115245379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115245379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115245390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115245400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115245400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115245400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:48.712596 run osmo-msc_10.42.42.6(pid=4196): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4196)] 11:52:48.760417 run osmo-msc_10.42.42.6(pid=4196): stdout: | (launched: 2022-12-10_11:52:47.647123) 11:52:48.809792 run osmo-msc_10.42.42.6(pid=4196): stderr: | 20221210115247918 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115247918 DLGLOBAL DEBUG validating counter group 0x7fe2ec5e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115247918 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115247918 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115247919 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115247919 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115247921 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115247921 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115247921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115247922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:48.859363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Terminating (SIGTERM) 11:52:48.898950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Terminating (SIGTERM) 11:52:48.938557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4195): Terminating (SIGTERM) 11:52:48.978441 --- ParallelTerminationStrategy: PID 4189 died... 11:52:48.997445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Terminated: ok {rc=0} 11:52:49.041710 --- ParallelTerminationStrategy: PID 4192 died... 11:52:49.060510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Terminated: ok {rc=0} 11:52:49.105002 --- ParallelTerminationStrategy: PID 4195 died... 11:52:49.123749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4195): Terminated: ok {rc=0} 11:52:49.209792 bus /sierra_3: Setting Powered False 11:52:50.309026 bus /sierra_3: Setting Powered False 11:52:51.424330 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:52:52.571154 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:52.582840 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:52:52.651523 tst mo_mt_call_osmux.py: using LAC 28208 11:52:52.773865 tst mo_mt_call_osmux.py: using RAC 158 11:52:52.890884 tst mo_mt_call_osmux.py: using CellId 28208 11:52:53.007267 tst mo_mt_call_osmux.py: using BVCI 28209 11:52:53.115413 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:53.126477 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:53.137254 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:53.148207 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:53.159420 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:52:53.170456 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:52:53.283519 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:52:53.398788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:53.865574 run create_hlr_db(pid=4198): Launched 11:52:53.980049 bus /sierra_2: Setting Powered False 11:52:55.039352 run create_hlr_db(pid=4198): Terminated: ok {rc=0} 11:52:55.458827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4200): Launched 11:52:55.758980 run osmo-hlr_10.42.42.2(pid=4201): Launched 11:52:55.874936 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:56.402563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4203): Launched 11:52:56.702961 run osmo-stp_10.42.42.5(pid=4204): Launched 11:52:56.817792 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:57.360530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4206): Launched 11:52:57.662181 run osmo-msc_10.42.42.6(pid=4207): Launched 11:52:57.830893 run osmo-stp_10.42.42.5(pid=4204): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4204)] 11:52:57.958745 run osmo-stp_10.42.42.5(pid=4204): stdout: | (launched: 2022-12-10_11:52:56.647614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:58.086185 run osmo-stp_10.42.42.5(pid=4204): stderr: | 20221210115256816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115256816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115256817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115256817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115256817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115256817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115256818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:58.211156 run osmo-stp_10.42.42.5(pid=4204): stdout: | (launched: 2022-12-10_11:52:56.647614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:58.331372 run osmo-stp_10.42.42.5(pid=4204): stderr: | 20221210115256816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115256816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115256817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115256817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115256817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115256817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115256818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:58.474559 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4204): Process ended prematurely: osmo-stp_10.42.42.5(pid=4204) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4204)] [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:52:58.483333 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 11:52:58.509969 run osmo-hlr_10.42.42.2(pid=4201): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4201)] 11:52:58.557123 run osmo-hlr_10.42.42.2(pid=4201): stdout: | (launched: 2022-12-10_11:52:55.703907) 11:52:58.606182 run osmo-hlr_10.42.42.2(pid=4201): stderr: | 20221210115255876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115255876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115255876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115255876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115255876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115255876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115255889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115255898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115255899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115255899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:58.674616 run osmo-msc_10.42.42.6(pid=4207): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4207)] 11:52:58.721968 run osmo-msc_10.42.42.6(pid=4207): stdout: | (launched: 2022-12-10_11:52:57.607058) 11:52:58.770735 run osmo-msc_10.42.42.6(pid=4207): stderr: | 20221210115257881 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115257881 DLGLOBAL DEBUG validating counter group 0x7f481286cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115257881 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115257881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115257881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115257882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115257884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115257884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115257884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115257884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:58.819718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4200): Terminating (SIGTERM) 11:52:58.859370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4203): Terminating (SIGTERM) 11:52:58.898820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4206): Terminating (SIGTERM) 11:52:58.938520 --- ParallelTerminationStrategy: PID 4200 died... 11:52:58.957563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4200): Terminated: ok {rc=0} 11:52:59.001737 --- ParallelTerminationStrategy: PID 4203 died... 11:52:59.020009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4203): Terminated: ok {rc=0} 11:52:59.064054 --- ParallelTerminationStrategy: PID 4206 died... 11:52:59.082586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4206): Terminated: ok {rc=0} 11:52:59.168117 bus /sierra_3: Setting Powered False 11:53:00.268756 bus /sierra_3: Setting Powered False 11:53:01.401274 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:53:02.663434 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:02.670070 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:53:02.702756 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:53:02.728906 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:53:02.779004 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:53:02.812491 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:53:02.840095 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:53:03.393421 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:53:03.446298 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:03.458248 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:53:03.528114 tst mo_mt_call.py: using LAC 28209 11:53:03.653361 tst mo_mt_call.py: using RAC 159 11:53:03.780259 tst mo_mt_call.py: using CellId 28209 11:53:03.906696 tst mo_mt_call.py: using BVCI 28210 11:53:04.023763 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:04.035493 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:04.047099 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:04.059032 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:04.071174 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:04.083202 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:04.202186 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:04.318202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:04.785741 run create_hlr_db(pid=4212): Launched 11:53:04.901614 bus /sierra_2: Setting Powered False 11:53:05.961444 run create_hlr_db(pid=4212): Terminated: ok {rc=0} 11:53:06.401068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4214): Launched 11:53:06.722519 run osmo-hlr_10.42.42.2(pid=4215): Launched 11:53:06.845858 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:07.397090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4217): Launched 11:53:07.719958 run osmo-stp_10.42.42.5(pid=4218): Launched 11:53:07.843441 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:08.424734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4220): Launched 11:53:08.746158 run osmo-msc_10.42.42.6(pid=4221): Launched 11:53:08.925571 run osmo-stp_10.42.42.5(pid=4218): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4218)] 11:53:09.061180 run osmo-stp_10.42.42.5(pid=4218): stdout: | (launched: 2022-12-10_11:53:07.661585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:09.197319 run osmo-stp_10.42.42.5(pid=4218): stderr: | 20221210115307852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115307852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115307852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115307853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115307853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115307853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115307853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:09.331717 run osmo-stp_10.42.42.5(pid=4218): stdout: | (launched: 2022-12-10_11:53:07.661585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:09.459656 run osmo-stp_10.42.42.5(pid=4218): stderr: | 20221210115307852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115307852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115307852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115307853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115307853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115307853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115307853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:09.612771 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4218): Process ended prematurely: osmo-stp_10.42.42.5(pid=4218) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4218)] [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:53:09.622425 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:53:09.650017 run osmo-hlr_10.42.42.2(pid=4215): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4215)] 11:53:09.699674 run osmo-hlr_10.42.42.2(pid=4215): stdout: | (launched: 2022-12-10_11:53:06.664550) 11:53:09.750800 run osmo-hlr_10.42.42.2(pid=4215): stderr: | 20221210115306861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115306862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115306862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115306862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115306862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115306862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115306874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115306882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115306882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115306882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:09.822657 run osmo-msc_10.42.42.6(pid=4221): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4221)] 11:53:09.872126 run osmo-msc_10.42.42.6(pid=4221): stdout: | (launched: 2022-12-10_11:53:08.687678) 11:53:09.923008 run osmo-msc_10.42.42.6(pid=4221): stderr: | 20221210115309007 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115309008 DLGLOBAL DEBUG validating counter group 0x7fdd47b57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115309008 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115309008 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115309008 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115309008 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115309010 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115309010 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115309010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115309010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:09.974389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4214): Terminating (SIGTERM) 11:53:10.015584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4217): Terminating (SIGTERM) 11:53:10.056675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4220): Terminating (SIGTERM) 11:53:10.098530 --- ParallelTerminationStrategy: PID 4214 died... 11:53:10.117938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4214): Terminated: ok {rc=0} 11:53:10.163815 --- ParallelTerminationStrategy: PID 4217 died... 11:53:10.183081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4217): Terminated: ok {rc=0} 11:53:10.228645 --- ParallelTerminationStrategy: PID 4220 died... 11:53:10.248274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4220): Terminated: ok {rc=0} 11:53:10.335414 bus /sierra_3: Setting Powered False 11:53:11.433667 bus /sierra_3: Setting Powered False 11:53:12.550673 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:53:13.695492 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:13.707630 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:53:13.778475 tst mo_mt_call_osmux.py: using LAC 28210 11:53:13.906835 tst mo_mt_call_osmux.py: using RAC 160 11:53:14.026802 tst mo_mt_call_osmux.py: using CellId 28210 11:53:14.145414 tst mo_mt_call_osmux.py: using BVCI 28211 11:53:14.254598 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:14.266383 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:14.277522 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:14.289062 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:14.300516 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:14.312051 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:14.425767 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:14.541289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:15.008778 run create_hlr_db(pid=4223): Launched 11:53:15.123959 bus /sierra_2: Setting Powered False 11:53:16.200078 run create_hlr_db(pid=4223): Terminated: ok {rc=0} 11:53:16.705759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4246): Launched 11:53:17.088835 run osmo-hlr_10.42.42.2(pid=4262): Launched 11:53:17.348814 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:18.054084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4292): Launched 11:53:18.469258 run osmo-stp_10.42.42.5(pid=4320): Launched 11:53:18.768724 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:19.549775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4457): Launched 11:53:19.939276 run osmo-msc_10.42.42.6(pid=4501): Launched 11:53:20.254596 run osmo-stp_10.42.42.5(pid=4320): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4320)] 11:53:20.594183 run osmo-stp_10.42.42.5(pid=4320): stdout: | (launched: 2022-12-10_11:53:18.389394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:20.787973 run osmo-stp_10.42.42.5(pid=4320): stderr: | 20221210115318752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115318752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115318752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115318752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115318759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115318759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115318759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:20.919144 run osmo-stp_10.42.42.5(pid=4320): stdout: | (launched: 2022-12-10_11:53:18.389394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:21.043277 run osmo-stp_10.42.42.5(pid=4320): stderr: | 20221210115318752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115318752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115318752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115318752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115318759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115318759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115318759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:21.192435 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4320): Process ended prematurely: osmo-stp_10.42.42.5(pid=4320) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4320)] [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:53:21.202298 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 11:53:21.232330 run osmo-hlr_10.42.42.2(pid=4262): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4262)] 11:53:21.282696 run osmo-hlr_10.42.42.2(pid=4262): stdout: | (launched: 2022-12-10_11:53:17.024824) 11:53:21.336363 run osmo-hlr_10.42.42.2(pid=4262): stderr: | 20221210115317344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115317344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115317344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115317344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115317344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115317345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115317363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115317379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115317380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115317380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:21.408766 run osmo-msc_10.42.42.6(pid=4501): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4501)] 11:53:21.459671 run osmo-msc_10.42.42.6(pid=4501): stdout: | (launched: 2022-12-10_11:53:19.869840) 11:53:21.513130 run osmo-msc_10.42.42.6(pid=4501): stderr: | 20221210115320417 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115320417 DLGLOBAL DEBUG validating counter group 0x7f5abb9fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115320417 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115320417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115320417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115320418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115320419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115320420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115320420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115320420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:21.566145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4246): Terminating (SIGTERM) 11:53:21.610038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4292): Terminating (SIGTERM) 11:53:21.655253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4457): Terminating (SIGTERM) 11:53:21.700806 --- ParallelTerminationStrategy: PID 4246 died... 11:53:21.722205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4246): Terminated: ok {rc=0} 11:53:21.771942 --- ParallelTerminationStrategy: PID 4292 died... 11:53:21.794654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4292): Terminated: ok {rc=0} 11:53:21.841045 --- ParallelTerminationStrategy: PID 4457 died... 11:53:21.860689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4457): Terminated: ok {rc=0} 11:53:21.950781 bus /sierra_3: Setting Powered False 11:53:23.052922 bus /sierra_3: Setting Powered False 11:53:24.173830 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:53:25.431487 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:25.437731 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:53:25.474584 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:53:25.503280 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:53:25.556679 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:53:25.591289 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:53:25.619671 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:53:26.166298 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:53:26.219311 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:26.231439 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:53:26.305168 tst mo_mt_call.py: using LAC 28211 11:53:26.426274 tst mo_mt_call.py: using RAC 161 11:53:26.548769 tst mo_mt_call.py: using CellId 28211 11:53:26.670949 tst mo_mt_call.py: using BVCI 28212 11:53:26.787429 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:26.799415 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:26.811010 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:26.823503 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:26.836126 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:26.848559 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:53:26.970225 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:53:27.090238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:27.582609 run create_hlr_db(pid=4508): Launched 11:53:27.744720 bus /sierra_2: Setting Powered False 11:53:28.806384 run create_hlr_db(pid=4508): Terminated: ok {rc=0} 11:53:29.246102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4510): Launched 11:53:29.579506 run osmo-hlr_10.42.42.2(pid=4511): Launched 11:53:29.825225 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:30.558286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4513): Launched 11:53:30.915914 run osmo-stp_10.42.42.5(pid=4514): Launched 11:53:31.140398 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:31.883651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4516): Launched 11:53:32.295608 run osmo-msc_10.42.42.6(pid=4517): Launched 11:53:32.722136 run osmo-stp_10.42.42.5(pid=4514): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4514)] 11:53:32.999697 run osmo-stp_10.42.42.5(pid=4514): stdout: | (launched: 2022-12-10_11:53:30.826966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:33.236509 run osmo-stp_10.42.42.5(pid=4514): stderr: | 20221210115331202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115331202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115331202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115331203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115331203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115331203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115331203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:33.373850 run osmo-stp_10.42.42.5(pid=4514): stdout: | (launched: 2022-12-10_11:53:30.826966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:33.504773 run osmo-stp_10.42.42.5(pid=4514): stderr: | 20221210115331202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115331202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115331202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115331203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115331203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115331203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115331203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:33.661569 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4514): Process ended prematurely: osmo-stp_10.42.42.5(pid=4514) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4514)] [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:53:33.672033 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 11:53:33.701956 run osmo-hlr_10.42.42.2(pid=4511): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4511)] 11:53:33.753997 run osmo-hlr_10.42.42.2(pid=4511): stdout: | (launched: 2022-12-10_11:53:29.513806) 11:53:33.807769 run osmo-hlr_10.42.42.2(pid=4511): stderr: | 20221210115329868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115329868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115329868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115329868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115329868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115329868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115329887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115329896 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115329903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115329903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:33.882237 run osmo-msc_10.42.42.6(pid=4517): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4517)] 11:53:33.934103 run osmo-msc_10.42.42.6(pid=4517): stdout: | (launched: 2022-12-10_11:53:32.217048) 11:53:33.987509 run osmo-msc_10.42.42.6(pid=4517): stderr: | 20221210115332788 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115332788 DLGLOBAL DEBUG validating counter group 0x7f317af06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115332788 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115332793 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115332793 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115332794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115332799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115332800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115332800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115332800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:34.040784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4510): Terminating (SIGTERM) 11:53:34.083927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4513): Terminating (SIGTERM) 11:53:34.127474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4516): Terminating (SIGTERM) 11:53:34.171654 --- ParallelTerminationStrategy: PID 4510 died... 11:53:34.192224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4510): Terminated: ok {rc=0} 11:53:34.241737 --- ParallelTerminationStrategy: PID 4513 died... 11:53:34.262147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4513): Terminated: ok {rc=0} 11:53:34.310016 --- ParallelTerminationStrategy: PID 4516 died... 11:53:34.330427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4516): Terminated: ok {rc=0} 11:53:34.421487 bus /sierra_3: Setting Powered False 11:53:35.524137 bus /sierra_3: Setting Powered False 11:53:36.643641 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:53:37.796411 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:37.809194 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:53:37.881828 tst mo_mt_call_osmux.py: using LAC 28212 11:53:38.005289 tst mo_mt_call_osmux.py: using RAC 162 11:53:38.128030 tst mo_mt_call_osmux.py: using CellId 28212 11:53:38.252566 tst mo_mt_call_osmux.py: using BVCI 28213 11:53:38.369340 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:38.381498 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:38.393283 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:38.406400 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:38.420373 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:38.433327 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:53:38.553950 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:53:38.674940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:39.170045 run create_hlr_db(pid=4519): Launched 11:53:39.330796 bus /sierra_2: Setting Powered False 11:53:40.392605 run create_hlr_db(pid=4519): Terminated: ok {rc=0} 11:53:40.840496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4522): Launched 11:53:41.161754 run osmo-hlr_10.42.42.2(pid=4523): Launched 11:53:41.284098 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:41.841327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4525): Launched 11:53:42.161120 run osmo-stp_10.42.42.5(pid=4526): Launched 11:53:42.282815 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:42.868417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4528): Launched 11:53:43.192364 run osmo-msc_10.42.42.6(pid=4529): Launched 11:53:43.372086 run osmo-stp_10.42.42.5(pid=4526): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4526)] 11:53:43.508378 run osmo-stp_10.42.42.5(pid=4526): stdout: | (launched: 2022-12-10_11:53:42.103100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:43.643933 run osmo-stp_10.42.42.5(pid=4526): stderr: | 20221210115342296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115342296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115342297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115342297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115342298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115342298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115342298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:43.779288 run osmo-stp_10.42.42.5(pid=4526): stdout: | (launched: 2022-12-10_11:53:42.103100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:43.908093 run osmo-stp_10.42.42.5(pid=4526): stderr: | 20221210115342296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115342296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115342297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115342297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115342298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115342298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115342298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:44.062339 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4526): Process ended prematurely: osmo-stp_10.42.42.5(pid=4526) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4526)] [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:53:44.072084 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:53:44.099963 run osmo-hlr_10.42.42.2(pid=4523): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4523)] 11:53:44.149920 run osmo-hlr_10.42.42.2(pid=4523): stdout: | (launched: 2022-12-10_11:53:41.103664) 11:53:44.201463 run osmo-hlr_10.42.42.2(pid=4523): stderr: | 20221210115341301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115341302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115341302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115341302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115341302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115341302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115341318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115341327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115341327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115341327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:44.273236 run osmo-msc_10.42.42.6(pid=4529): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4529)] 11:53:44.323029 run osmo-msc_10.42.42.6(pid=4529): stdout: | (launched: 2022-12-10_11:53:43.133566) 11:53:44.374489 run osmo-msc_10.42.42.6(pid=4529): stderr: | 20221210115343458 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115343458 DLGLOBAL DEBUG validating counter group 0x7f97bb7a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115343458 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115343458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115343458 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115343459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115343460 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115343461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115343461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115343461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:44.426301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4522): Terminating (SIGTERM) 11:53:44.467670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4525): Terminating (SIGTERM) 11:53:44.509367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4528): Terminating (SIGTERM) 11:53:44.551256 --- ParallelTerminationStrategy: PID 4522 died... 11:53:44.571225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4522): Terminated: ok {rc=0} 11:53:44.617455 --- ParallelTerminationStrategy: PID 4525 died... 11:53:44.636897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4525): Terminated: ok {rc=0} 11:53:44.683362 --- ParallelTerminationStrategy: PID 4528 died... 11:53:44.703125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4528): Terminated: ok {rc=0} 11:53:44.791364 bus /sierra_3: Setting Powered False 11:53:45.905707 bus /sierra_3: Setting Powered False 11:53:47.028362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:53:48.281117 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:48.287090 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:53:48.319712 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:53:48.345714 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:53:48.394716 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:53:48.426836 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:53:48.453158 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:53:49.006486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:53:49.055308 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:49.066622 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:53:49.116023 tst mo_mt_call.py: using LAC 28213 11:53:49.233639 tst mo_mt_call.py: using RAC 163 11:53:49.359963 tst mo_mt_call.py: using CellId 28213 11:53:49.488637 tst mo_mt_call.py: using BVCI 28214 11:53:49.607118 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:49.618921 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:49.630537 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:49.642296 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:49.654232 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:49.665988 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:53:49.783002 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:53:49.900691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:50.398208 run create_hlr_db(pid=4534): Launched 11:53:50.529460 bus /sierra_2: Setting Powered False 11:53:51.593711 run create_hlr_db(pid=4534): Terminated: ok {rc=0} 11:53:52.024558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Launched 11:53:52.327258 run osmo-hlr_10.42.42.2(pid=4537): Launched 11:53:52.443006 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:52.974823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Launched 11:53:53.276329 run osmo-stp_10.42.42.5(pid=4540): Launched 11:53:53.391752 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:53.934995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Launched 11:53:54.235329 run osmo-msc_10.42.42.6(pid=4543): Launched 11:53:54.403964 run osmo-stp_10.42.42.5(pid=4540): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] 11:53:54.532015 run osmo-stp_10.42.42.5(pid=4540): stdout: | (launched: 2022-12-10_11:53:53.221288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:54.659857 run osmo-stp_10.42.42.5(pid=4540): stderr: | 20221210115353392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115353393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115353393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115353393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115353394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115353394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115353394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:54.785297 run osmo-stp_10.42.42.5(pid=4540): stdout: | (launched: 2022-12-10_11:53:53.221288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:54.905404 run osmo-stp_10.42.42.5(pid=4540): stderr: | 20221210115353392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115353393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115353393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115353393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115353394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115353394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115353394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:55.048838 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4540): Process ended prematurely: osmo-stp_10.42.42.5(pid=4540) [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:53:55.057801 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:53:55.084308 run osmo-hlr_10.42.42.2(pid=4537): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4537)] 11:53:55.132243 run osmo-hlr_10.42.42.2(pid=4537): stdout: | (launched: 2022-12-10_11:53:52.272099) 11:53:55.181568 run osmo-hlr_10.42.42.2(pid=4537): stderr: | 20221210115352448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115352448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115352448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115352448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115352448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115352448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115352460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115352468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115352469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115352469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:55.250260 run osmo-msc_10.42.42.6(pid=4543): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4543)] 11:53:55.297878 run osmo-msc_10.42.42.6(pid=4543): stdout: | (launched: 2022-12-10_11:53:54.180070) 11:53:55.347151 run osmo-msc_10.42.42.6(pid=4543): stderr: | 20221210115354451 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115354451 DLGLOBAL DEBUG validating counter group 0x7fafc376dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115354451 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115354451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115354451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115354451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115354454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115354454 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115354454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115354454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:55.396761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Terminating (SIGTERM) 11:53:55.436184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Terminating (SIGTERM) 11:53:55.475822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Terminating (SIGTERM) 11:53:55.515875 --- ParallelTerminationStrategy: PID 4536 died... 11:53:55.534800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Terminated: ok {rc=0} 11:53:55.578765 --- ParallelTerminationStrategy: PID 4539 died... 11:53:55.597724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Terminated: ok {rc=0} 11:53:55.641540 --- ParallelTerminationStrategy: PID 4542 died... 11:53:55.659892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Terminated: ok {rc=0} 11:53:55.742747 bus /sierra_3: Setting Powered False 11:53:56.839373 bus /sierra_3: Setting Powered False 11:53:57.955439 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:53:59.103037 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:59.115498 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:53:59.169642 tst mo_mt_call_osmux.py: using LAC 28214 11:53:59.296890 tst mo_mt_call_osmux.py: using RAC 164 11:53:59.422784 tst mo_mt_call_osmux.py: using CellId 28214 11:53:59.549540 tst mo_mt_call_osmux.py: using BVCI 28215 11:53:59.666410 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:59.678103 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:59.689567 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:59.701013 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:59.712617 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:53:59.724099 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:53:59.838748 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:53:59.954248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:00.421636 run create_hlr_db(pid=4545): Launched 11:54:00.537874 bus /sierra_2: Setting Powered False 11:54:01.617440 run create_hlr_db(pid=4545): Terminated: ok {rc=0} 11:54:02.153794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4547): Launched 11:54:02.475732 run osmo-hlr_10.42.42.2(pid=4548): Launched 11:54:02.591609 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:03.123924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4550): Launched 11:54:03.425832 run osmo-stp_10.42.42.5(pid=4551): Launched 11:54:03.541986 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:04.087196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4553): Launched 11:54:04.389306 run osmo-msc_10.42.42.6(pid=4554): Launched 11:54:04.558965 run osmo-stp_10.42.42.5(pid=4551): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4551)] 11:54:04.687267 run osmo-stp_10.42.42.5(pid=4551): stdout: | (launched: 2022-12-10_11:54:03.370957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:04.816161 run osmo-stp_10.42.42.5(pid=4551): stderr: | 20221210115403540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115403540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115403541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115403541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115403542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115403542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115403542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:04.941656 run osmo-stp_10.42.42.5(pid=4551): stdout: | (launched: 2022-12-10_11:54:03.370957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:05.062267 run osmo-stp_10.42.42.5(pid=4551): stderr: | 20221210115403540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115403540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115403541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115403541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115403542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115403542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115403542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:05.206516 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4551): Process ended prematurely: osmo-stp_10.42.42.5(pid=4551) [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4551)] [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:54:05.215466 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:54:05.241963 run osmo-hlr_10.42.42.2(pid=4548): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4548)] 11:54:05.289735 run osmo-hlr_10.42.42.2(pid=4548): stdout: | (launched: 2022-12-10_11:54:02.420466) 11:54:05.339112 run osmo-hlr_10.42.42.2(pid=4548): stderr: | 20221210115402596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115402596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115402596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115402596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115402596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115402596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115402608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115402617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115402617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115402617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:05.407755 run osmo-msc_10.42.42.6(pid=4554): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4554)] 11:54:05.455634 run osmo-msc_10.42.42.6(pid=4554): stdout: | (launched: 2022-12-10_11:54:04.334032) 11:54:05.504754 run osmo-msc_10.42.42.6(pid=4554): stderr: | 20221210115404605 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115404606 DLGLOBAL DEBUG validating counter group 0x7f1a350cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115404606 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115404606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115404606 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115404606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115404608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115404608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115404608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115404608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:05.554597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4547): Terminating (SIGTERM) 11:54:05.594056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4550): Terminating (SIGTERM) 11:54:05.633615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4553): Terminating (SIGTERM) 11:54:05.673658 --- ParallelTerminationStrategy: PID 4547 died... 11:54:05.692611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4547): Terminated: ok {rc=0} 11:54:05.736772 --- ParallelTerminationStrategy: PID 4550 died... 11:54:05.755342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4550): Terminated: ok {rc=0} 11:54:05.799356 --- ParallelTerminationStrategy: PID 4553 died... 11:54:05.817910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4553): Terminated: ok {rc=0} 11:54:05.903477 bus /sierra_3: Setting Powered False 11:54:07.002000 bus /sierra_3: Setting Powered False 11:54:08.115196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:trx-umtrx --------------------------------------------------------------------- 11:54:09.363188 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:09.367540 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:54:09.400075 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:54:09.426570 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 11:54:09.507637 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:54:09.539571 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:54:09.565956 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 11:54:10.148759 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 11:54:10.154001 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:10.164547 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 11:54:10.212151 tst emergency_mo_mt_call.py: using LAC 28215 11:54:10.327633 tst emergency_mo_mt_call.py: using RAC 165 11:54:10.442203 tst emergency_mo_mt_call.py: using CellId 28215 11:54:10.556445 tst emergency_mo_mt_call.py: using BVCI 28216 11:54:10.663391 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:10.674158 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:10.684616 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:10.695396 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:10.706101 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:10.716667 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:10.833323 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:10.953719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:11.446730 run create_hlr_db(pid=4559): Launched 11:54:11.575837 bus /sierra_2: Setting Powered False 11:54:12.639877 run create_hlr_db(pid=4559): Terminated: ok {rc=0} 11:54:13.065160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Launched 11:54:13.362059 run osmo-hlr_10.42.42.2(pid=4562): Launched 11:54:13.475616 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:13.999671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Launched 11:54:14.295828 run osmo-stp_10.42.42.5(pid=4565): Launched 11:54:14.422633 tst emergency_mo_mt_call.py: using MSISDN 7720 11:54:14.575148 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:15.108386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Launched 11:54:15.427313 run osmo-msc_10.42.42.6(pid=4568): Launched 11:54:15.605480 run osmo-stp_10.42.42.5(pid=4565): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] 11:54:15.739303 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-10_11:54:14.241685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:15.936826 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221210115414412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115414412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115414412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115414412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115414415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115414415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115414415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:16.095273 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-10_11:54:14.241685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:16.225989 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221210115414412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115414412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115414412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115414412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115414415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115414415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115414415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:16.381518 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2374↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] [trial-2374↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 11:54:16.391104 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 11:54:16.420400 run osmo-hlr_10.42.42.2(pid=4562): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4562)] 11:54:16.471809 run osmo-hlr_10.42.42.2(pid=4562): stdout: | (launched: 2022-12-10_11:54:13.307924) 11:54:16.525203 run osmo-hlr_10.42.42.2(pid=4562): stderr: | 20221210115413480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115413481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115413481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115413481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115413481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115413481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115413493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115413502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115413502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115413502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:16.598656 run osmo-msc_10.42.42.6(pid=4568): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4568)] 11:54:16.650247 run osmo-msc_10.42.42.6(pid=4568): stdout: | (launched: 2022-12-10_11:54:15.369689) 11:54:16.703268 run osmo-msc_10.42.42.6(pid=4568): stderr: | 20221210115415692 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115415692 DLGLOBAL DEBUG validating counter group 0x7ff397f35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115415692 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115415693 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115415693 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115415693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115415695 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115415695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115415695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115415695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:16.756354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminating (SIGTERM) 11:54:16.800375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminating (SIGTERM) 11:54:16.845449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Terminating (SIGTERM) 11:54:16.890669 --- ParallelTerminationStrategy: PID 4561 died... 11:54:16.910928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminated: ok {rc=0} 11:54:16.959620 --- ParallelTerminationStrategy: PID 4564 died... 11:54:16.979619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminated: ok {rc=0} 11:54:17.027419 --- ParallelTerminationStrategy: PID 4567 died... 11:54:17.047312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Terminated: ok {rc=0} 11:54:17.137717 bus /sierra_3: Setting Powered False 11:54:18.237414 bus /sierra_3: Setting Powered False 11:54:19.350752 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 11:54:20.436443 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:20.448291 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 11:54:20.497848 tst emergency_preemptive_call.py: using LAC 28216 11:54:20.620712 tst emergency_preemptive_call.py: using RAC 166 11:54:20.742635 tst emergency_preemptive_call.py: using CellId 28216 11:54:20.865707 tst emergency_preemptive_call.py: using BVCI 28217 11:54:20.980565 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:20.991603 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:21.002476 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:21.013367 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:21.024099 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:21.034807 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:21.151123 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:21.265705 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:21.383580 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:21.496800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:21.957790 run create_hlr_db(pid=4570): Launched 11:54:22.072040 bus /sierra_2: Setting Powered False 11:54:23.132327 run create_hlr_db(pid=4570): Terminated: ok {rc=0} 11:54:23.567666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4572): Launched 11:54:23.886569 run osmo-hlr_10.42.42.2(pid=4573): Launched 11:54:24.008158 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:24.555047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4575): Launched 11:54:24.873112 run osmo-stp_10.42.42.5(pid=4576): Launched 11:54:25.005372 tst emergency_preemptive_call.py: using MSISDN 7721 11:54:25.169359 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:25.738363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4578): Launched 11:54:26.055443 run osmo-msc_10.42.42.6(pid=4579): Launched 11:54:26.232576 run osmo-stp_10.42.42.5(pid=4576): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4576)] 11:54:26.366632 run osmo-stp_10.42.42.5(pid=4576): stdout: | (launched: 2022-12-10_11:54:24.815174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:26.499951 run osmo-stp_10.42.42.5(pid=4576): stderr: | 20221210115425009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115425009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115425010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115425010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115425010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115425010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115425011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:26.634028 run osmo-stp_10.42.42.5(pid=4576): stdout: | (launched: 2022-12-10_11:54:24.815174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:26.760840 run osmo-stp_10.42.42.5(pid=4576): stderr: | 20221210115425009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115425009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115425010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115425010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115425010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115425010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115425011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:26.913611 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4576): Process ended prematurely: osmo-stp_10.42.42.5(pid=4576) [trial-2374↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4576)] [trial-2374↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 11:54:26.922637 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 11:54:26.950487 run osmo-hlr_10.42.42.2(pid=4573): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4573)] 11:54:27.000829 run osmo-hlr_10.42.42.2(pid=4573): stdout: | (launched: 2022-12-10_11:54:23.828436) 11:54:27.052684 run osmo-hlr_10.42.42.2(pid=4573): stderr: | 20221210115424025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115424025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115424025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115424025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115424025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115424026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115424047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115424058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115424058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115424058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:27.124764 run osmo-msc_10.42.42.6(pid=4579): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4579)] 11:54:27.174538 run osmo-msc_10.42.42.6(pid=4579): stdout: | (launched: 2022-12-10_11:54:25.997907) 11:54:27.225888 run osmo-msc_10.42.42.6(pid=4579): stderr: | 20221210115426318 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210115426318 DLGLOBAL DEBUG validating counter group 0x7ff86c010c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210115426319 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210115426319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210115426319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210115426319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210115426321 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210115426322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210115426322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210115426322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:27.277572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4572): Terminating (SIGTERM) 11:54:27.319310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4575): Terminating (SIGTERM) 11:54:27.361137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4578): Terminating (SIGTERM) 11:54:27.403442 --- ParallelTerminationStrategy: PID 4572 died... 11:54:27.423444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4572): Terminated: ok {rc=0} 11:54:27.470127 --- ParallelTerminationStrategy: PID 4575 died... 11:54:27.489887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4575): Terminated: ok {rc=0} 11:54:27.536066 --- ParallelTerminationStrategy: PID 4578 died... 11:54:27.555769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4578): Terminated: ok {rc=0} 11:54:27.642959 bus /sierra_9: Setting Powered False 11:54:28.740534 bus /sierra_9: Setting Powered False 11:54:29.855855 bus /sierra_8: Setting Powered False 11:54:30.956001 bus /sierra_8: Setting Powered False 11:54:32.088467 bus /sierra_3: Setting Powered False 11:54:33.188189 bus /sierra_3: Setting Powered False 11:54:34.305195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx --------------------------------------------------------------------- 11:54:35.580840 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:35.585890 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:54:35.618650 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 11:54:35.656349 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 11:54:35.746739 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:54:35.779036 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 11:54:35.816800 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 11:54:36.398827 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 11:54:36.448305 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:36.458835 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:54:36.504730 tst cs_paging_gprs_active.py: using LAC 28217 11:54:36.622981 tst cs_paging_gprs_active.py: using RAC 167 11:54:36.739685 tst cs_paging_gprs_active.py: using CellId 28217 11:54:36.856410 tst cs_paging_gprs_active.py: using BVCI 28218 11:54:36.965585 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:36.976041 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:36.986284 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:36.996790 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:37.007387 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:37.017878 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:37.028441 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:37.038940 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:37.049523 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:37.165386 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:37.284308 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:54:37.503448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:54:37.827826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Launched 11:54:38.108520 run iperf3-srv_10.42.42.10(pid=4585): Launched 11:54:38.229856 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:54:38.448107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:54:38.770931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Launched 11:54:39.051011 run iperf3-srv_10.42.42.10(pid=4587): Launched 11:54:39.172662 tst cs_paging_gprs_active.py:38: start network... 11:54:39.390399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:39.891376 run create_hlr_db(pid=4588): Launched 11:54:40.023813 bus /sierra_2: Setting Powered False 11:54:41.087486 run create_hlr_db(pid=4588): Terminated: ok {rc=0} 11:54:41.519621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Launched 11:54:41.822978 run osmo-hlr_10.42.42.2(pid=4591): Launched 11:54:41.938587 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:42.455444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Launched 11:54:42.755975 run osmo-stp_10.42.42.5(pid=4594): Launched 11:54:42.871438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:54:43.390063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Launched 11:54:43.505691 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:54:43.758614 run patchelf(pid=4597): Launched 11:54:43.926810 run osmo-stp_10.42.42.5(pid=4594): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)] 11:54:44.054315 run osmo-stp_10.42.42.5(pid=4594): stdout: | (launched: 2022-12-10_11:54:42.701157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:44.183518 run osmo-stp_10.42.42.5(pid=4594): stderr: | 20221210115442870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115442870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115442871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115442871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115442871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115442872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115442872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:44.313409 run osmo-stp_10.42.42.5(pid=4594): stdout: | (launched: 2022-12-10_11:54:42.701157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:44.437442 run osmo-stp_10.42.42.5(pid=4594): stderr: | 20221210115442870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115442870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115442871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115442871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115442871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115442872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115442872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:44.583552 run patchelf(pid=4597): Terminating (SIGINT) 11:54:44.752201 run patchelf(pid=4597): Terminated: ok {rc=0} 11:54:44.874627 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4594): Process ended prematurely: osmo-stp_10.42.42.5(pid=4594) [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)] [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 11:54:44.884059 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:54:44.911504 run osmo-hlr_10.42.42.2(pid=4591): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4591)] 11:54:44.958724 run osmo-hlr_10.42.42.2(pid=4591): stdout: | (launched: 2022-12-10_11:54:41.767674) 11:54:45.007478 run osmo-hlr_10.42.42.2(pid=4591): stderr: | 20221210115441942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115441942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115441942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115441942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115441942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115441942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115441959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115441970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115441970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115441970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:45.056778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Terminating (SIGTERM) 11:54:45.096282 run iperf3-srv_10.42.42.10(pid=4585): Terminating (SIGTERM) 11:54:45.135991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Terminating (SIGTERM) 11:54:45.175491 run iperf3-srv_10.42.42.10(pid=4587): Terminating (SIGTERM) 11:54:45.214769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Terminating (SIGTERM) 11:54:45.254139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Terminating (SIGTERM) 11:54:45.293475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Terminating (SIGTERM) 11:54:45.333189 --- ParallelTerminationStrategy: PID 4584 died... 11:54:45.351995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Terminated: ok {rc=0} 11:54:45.396048 --- ParallelTerminationStrategy: PID 4585 died... 11:54:45.414336 run iperf3-srv_10.42.42.10(pid=4585): Terminated {rc=256} 11:54:45.458116 --- ParallelTerminationStrategy: PID 4586 died... 11:54:45.476309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Terminated: ok {rc=0} 11:54:45.520166 --- ParallelTerminationStrategy: PID 4587 died... 11:54:45.538587 run iperf3-srv_10.42.42.10(pid=4587): Terminated {rc=256} 11:54:45.582363 --- ParallelTerminationStrategy: PID 4590 died... 11:54:45.600546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Terminated: ok {rc=0} 11:54:45.644620 --- ParallelTerminationStrategy: PID 4593 died... 11:54:45.663124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Terminated: ok {rc=0} 11:54:45.706970 --- ParallelTerminationStrategy: PID 4596 died... 11:54:45.725496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Terminated: ok {rc=0} 11:54:45.809264 bus /gobi_0: Setting Powered False 11:54:46.918671 bus /gobi_0: Setting Powered False 11:54:48.038498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx iperf3.py ---------------------------------------------- 11:54:49.184210 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.195276 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:54:49.245239 tst iperf3.py: using LAC 28218 11:54:49.364885 tst iperf3.py: using RAC 168 11:54:49.482468 tst iperf3.py: using CellId 28218 11:54:49.602432 tst iperf3.py: using BVCI 28219 11:54:49.712866 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.723484 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.733847 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.744400 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.754887 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.765335 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.775849 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.786346 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:49.797005 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:49.910183 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:54:50.113791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:54:50.416175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Launched 11:54:50.679613 run iperf3-srv_10.42.42.10(pid=4599): Launched 11:54:50.793147 tst iperf3.py:8: start network... 11:54:50.996104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:51.463598 run create_hlr_db(pid=4600): Launched 11:54:51.578930 bus /gobi_6: Setting Powered False 11:54:52.639617 run create_hlr_db(pid=4600): Terminated: ok {rc=0} 11:54:53.081684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Launched 11:54:53.406093 run osmo-hlr_10.42.42.2(pid=4603): Launched 11:54:53.529967 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:54.090182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Launched 11:54:54.411992 run osmo-stp_10.42.42.5(pid=4606): Launched 11:54:54.534855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:54:55.089341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Launched 11:54:55.213695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:54:55.486004 run patchelf(pid=4609): Launched 11:54:55.664896 run osmo-stp_10.42.42.5(pid=4606): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)] 11:54:55.801412 run osmo-stp_10.42.42.5(pid=4606): stdout: | (launched: 2022-12-10_11:54:54.353581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:55.939907 run osmo-stp_10.42.42.5(pid=4606): stderr: | 20221210115454545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115454545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115454545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115454545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115454548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115454548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115454548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:56.078383 run osmo-stp_10.42.42.5(pid=4606): stdout: | (launched: 2022-12-10_11:54:54.353581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:56.210081 run osmo-stp_10.42.42.5(pid=4606): stderr: | 20221210115454545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115454545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115454545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115454545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115454548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115454548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115454548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:56.366772 run patchelf(pid=4609): Terminating (SIGINT) 11:54:56.547420 run patchelf(pid=4609): Terminated: ok {rc=0} 11:54:56.677650 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4606): Process ended prematurely: osmo-stp_10.42.42.5(pid=4606) [trial-2374↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)] [trial-2374↪gprs:trx-umtrx↪iperf3.py:8] 11:54:56.687739 tst iperf3.py:8: Test FAILED (7.5 sec) 11:54:56.716083 run osmo-hlr_10.42.42.2(pid=4603): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4603)] 11:54:56.765493 run osmo-hlr_10.42.42.2(pid=4603): stdout: | (launched: 2022-12-10_11:54:53.347461) 11:54:56.817048 run osmo-hlr_10.42.42.2(pid=4603): stderr: | 20221210115453548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115453548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115453548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115453548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115453548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115453548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115453561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115453569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115453569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115453569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:56.868747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Terminating (SIGTERM) 11:54:56.910133 run iperf3-srv_10.42.42.10(pid=4599): Terminating (SIGTERM) 11:54:56.951411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Terminating (SIGTERM) 11:54:56.992822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Terminating (SIGTERM) 11:54:57.034127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Terminating (SIGTERM) 11:54:57.075754 --- ParallelTerminationStrategy: PID 4598 died... 11:54:57.095564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Terminated: ok {rc=0} 11:54:57.141425 --- ParallelTerminationStrategy: PID 4599 died... 11:54:57.160408 run iperf3-srv_10.42.42.10(pid=4599): Terminated {rc=256} 11:54:57.205890 --- ParallelTerminationStrategy: PID 4602 died... 11:54:57.225295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Terminated: ok {rc=0} 11:54:57.270882 --- ParallelTerminationStrategy: PID 4605 died... 11:54:57.290289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Terminated: ok {rc=0} 11:54:57.335657 --- ParallelTerminationStrategy: PID 4608 died... 11:54:57.354988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Terminated: ok {rc=0} 11:54:57.441767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 11:54:58.590928 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:58.602669 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:54:58.651815 tst iperf3m4.py: using LAC 28219 11:54:58.778398 tst iperf3m4.py: using RAC 169 11:54:58.905090 tst iperf3m4.py: using CellId 28219 11:54:59.032437 tst iperf3m4.py: using BVCI 28220 11:54:59.149417 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.160370 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.171123 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.181984 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.192608 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.203248 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.214185 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.224818 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:54:59.235770 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:59.350988 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:59.477480 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:59.593630 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:54:59.708733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:54:59.912644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:00.215486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Launched 11:55:00.479505 run iperf3-srv_10.42.42.10(pid=4611): Launched 11:55:00.593146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:55:00.795276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:01.114843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Launched 11:55:01.406967 run iperf3-srv_10.42.42.10(pid=4616): Launched 11:55:01.532298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:55:01.738594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:02.053149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4617): Launched 11:55:02.330096 run iperf3-srv_10.42.42.10(pid=4618): Launched 11:55:02.443602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:55:02.646198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:02.948822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4619): Launched 11:55:03.211530 run iperf3-srv_10.42.42.10(pid=4620): Launched 11:55:03.325378 tst iperf3m4.py:8: start network... 11:55:03.527427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:03.993472 run create_hlr_db(pid=4621): Launched 11:55:04.110460 bus /gobi_6: Setting Powered False 11:55:05.171080 run create_hlr_db(pid=4621): Terminated: ok {rc=0} 11:55:05.591680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4623): Launched 11:55:05.893755 run osmo-hlr_10.42.42.2(pid=4624): Launched 11:55:06.009852 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:06.530047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4626): Launched 11:55:06.832747 run osmo-stp_10.42.42.5(pid=4627): Launched 11:55:06.949802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:55:07.470839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4629): Launched 11:55:07.586784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:55:07.842264 run patchelf(pid=4630): Launched 11:55:08.010337 run osmo-stp_10.42.42.5(pid=4627): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4627)] 11:55:08.137751 run osmo-stp_10.42.42.5(pid=4627): stdout: | (launched: 2022-12-10_11:55:06.777297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:08.266907 run osmo-stp_10.42.42.5(pid=4627): stderr: | 20221210115506948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115506948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115506948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115506949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115506949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115506949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115506949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:08.395952 run osmo-stp_10.42.42.5(pid=4627): stdout: | (launched: 2022-12-10_11:55:06.777297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:08.519546 run osmo-stp_10.42.42.5(pid=4627): stderr: | 20221210115506948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115506948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115506948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115506949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115506949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115506949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115506949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:08.665642 run patchelf(pid=4630): Terminating (SIGINT) 11:55:08.834611 run patchelf(pid=4630): Terminated: ok {rc=0} 11:55:08.956439 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4627): Process ended prematurely: osmo-stp_10.42.42.5(pid=4627) [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4627)] [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8] 11:55:08.965901 tst iperf3m4.py:8: Test FAILED (10.4 sec) 11:55:08.993585 run osmo-hlr_10.42.42.2(pid=4624): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4624)] 11:55:09.040743 run osmo-hlr_10.42.42.2(pid=4624): stdout: | (launched: 2022-12-10_11:55:05.838428) 11:55:09.089572 run osmo-hlr_10.42.42.2(pid=4624): stderr: | 20221210115506014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115506014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115506014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115506014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115506014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115506014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115506026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115506035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115506035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115506035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:09.138659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminating (SIGTERM) 11:55:09.177957 run iperf3-srv_10.42.42.10(pid=4611): Terminating (SIGTERM) 11:55:09.217173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminating (SIGTERM) 11:55:09.256642 run iperf3-srv_10.42.42.10(pid=4616): Terminating (SIGTERM) 11:55:09.295939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4617): Terminating (SIGTERM) 11:55:09.335556 run iperf3-srv_10.42.42.10(pid=4618): Terminating (SIGTERM) 11:55:09.374850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4619): Terminating (SIGTERM) 11:55:09.414149 run iperf3-srv_10.42.42.10(pid=4620): Terminating (SIGTERM) 11:55:09.453472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4623): Terminating (SIGTERM) 11:55:09.492852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4626): Terminating (SIGTERM) 11:55:09.532098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4629): Terminating (SIGTERM) 11:55:09.571980 --- ParallelTerminationStrategy: PID 4610 died... 11:55:09.590796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminated: ok {rc=0} 11:55:09.634915 --- ParallelTerminationStrategy: PID 4611 died... 11:55:09.653334 run iperf3-srv_10.42.42.10(pid=4611): Terminated {rc=256} 11:55:09.697135 --- ParallelTerminationStrategy: PID 4612 died... 11:55:09.715418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminated: ok {rc=0} 11:55:09.759484 --- ParallelTerminationStrategy: PID 4616 died... 11:55:09.777925 run iperf3-srv_10.42.42.10(pid=4616): Terminated {rc=256} 11:55:09.821699 --- ParallelTerminationStrategy: PID 4617 died... 11:55:09.839836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4617): Terminated: ok {rc=0} 11:55:09.884184 --- ParallelTerminationStrategy: PID 4618 died... 11:55:09.902609 run iperf3-srv_10.42.42.10(pid=4618): Terminated {rc=256} 11:55:09.947098 --- ParallelTerminationStrategy: PID 4619 died... 11:55:09.965487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4619): Terminated: ok {rc=0} 11:55:10.009665 --- ParallelTerminationStrategy: PID 4620 died... 11:55:10.028062 run iperf3-srv_10.42.42.10(pid=4620): Terminated {rc=256} 11:55:10.071826 --- ParallelTerminationStrategy: PID 4623 died... 11:55:10.090377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4623): Terminated: ok {rc=0} 11:55:10.134034 --- ParallelTerminationStrategy: PID 4626 died... 11:55:10.152516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4626): Terminated: ok {rc=0} 11:55:10.196461 --- ParallelTerminationStrategy: PID 4629 died... 11:55:10.215051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4629): Terminated: ok {rc=0} 11:55:10.300773 bus /gobi_4: Setting Powered False 11:55:11.402579 bus /gobi_4: Setting Powered False 11:55:12.519669 bus /gobi_1: Setting Powered False 11:55:13.617543 bus /gobi_1: Setting Powered False 11:55:14.735985 bus /gobi_0: Setting Powered False 11:55:15.838614 bus /gobi_0: Setting Powered False 11:55:16.963942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx ping.py ---------------------------------------------- 11:55:18.077115 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.088124 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:55:18.136889 tst ping.py: using LAC 28220 11:55:18.254270 tst ping.py: using RAC 170 11:55:18.370478 tst ping.py: using CellId 28220 11:55:18.489227 tst ping.py: using BVCI 28221 11:55:18.606506 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.617704 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.628495 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.639980 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.651342 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.662767 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.674641 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:18.686638 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:55:18.801874 tst ping.py:19: start network... 11:55:19.001929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:19.462358 run create_hlr_db(pid=4631): Launched 11:55:19.576290 bus /gobi_6: Setting Powered False 11:55:20.636272 run create_hlr_db(pid=4631): Terminated: ok {rc=0} 11:55:21.050091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4633): Launched 11:55:21.346711 run osmo-hlr_10.42.42.2(pid=4634): Launched 11:55:21.461137 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:21.990785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4636): Launched 11:55:22.288442 run osmo-stp_10.42.42.5(pid=4637): Launched 11:55:22.403027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:55:22.916111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4639): Launched 11:55:23.030959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:55:23.282246 run patchelf(pid=4640): Launched 11:55:23.448237 run osmo-stp_10.42.42.5(pid=4637): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4637)] 11:55:23.575287 run osmo-stp_10.42.42.5(pid=4637): stdout: | (launched: 2022-12-10_11:55:22.233657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:23.702954 run osmo-stp_10.42.42.5(pid=4637): stderr: | 20221210115522404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115522404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115522404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115522405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115522405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115522405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115522405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:23.831017 run osmo-stp_10.42.42.5(pid=4637): stdout: | (launched: 2022-12-10_11:55:22.233657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:23.953571 run osmo-stp_10.42.42.5(pid=4637): stderr: | 20221210115522404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115522404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115522404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115522405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115522405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115522405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115522405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:24.098512 run patchelf(pid=4640): Terminating (SIGINT) 11:55:24.265429 run patchelf(pid=4640): Terminated: ok {rc=0} 11:55:24.385874 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4637): Process ended prematurely: osmo-stp_10.42.42.5(pid=4637) [trial-2374↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4637)] [trial-2374↪gprs:trx-umtrx↪ping.py:22] 11:55:24.394670 tst ping.py:22: Test FAILED (6.3 sec) 11:55:24.422007 run osmo-hlr_10.42.42.2(pid=4634): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4634)] 11:55:24.469979 run osmo-hlr_10.42.42.2(pid=4634): stdout: | (launched: 2022-12-10_11:55:21.291775) 11:55:24.519555 run osmo-hlr_10.42.42.2(pid=4634): stderr: | 20221210115521466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115521466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115521466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115521466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115521466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115521466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115521478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115521487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115521487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115521487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:24.569566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4633): Terminating (SIGTERM) 11:55:24.609554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4636): Terminating (SIGTERM) 11:55:24.649592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4639): Terminating (SIGTERM) 11:55:24.690119 --- ParallelTerminationStrategy: PID 4633 died... 11:55:24.709330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4633): Terminated: ok {rc=0} 11:55:24.754016 --- ParallelTerminationStrategy: PID 4636 died... 11:55:24.772564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4636): Terminated: ok {rc=0} 11:55:24.817232 --- ParallelTerminationStrategy: PID 4639 died... 11:55:24.835876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4639): Terminated: ok {rc=0} 11:55:24.923953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 11:55:26.011988 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.023291 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:55:26.072337 tst ping_idle_ping.py: using LAC 28221 11:55:26.191098 tst ping_idle_ping.py: using RAC 171 11:55:26.307277 tst ping_idle_ping.py: using CellId 28221 11:55:26.425261 tst ping_idle_ping.py: using BVCI 28222 11:55:26.533203 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.543674 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.554123 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.564545 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.575020 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.585534 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.596200 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:55:26.606829 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:55:26.726259 tst ping_idle_ping.py:24: start network... 11:55:26.942731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:27.439030 run create_hlr_db(pid=4642): Launched 11:55:27.569885 bus /gobi_6: Setting Powered False 11:55:28.634021 run create_hlr_db(pid=4642): Terminated: ok {rc=0} 11:55:29.060555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Launched 11:55:29.361424 run osmo-hlr_10.42.42.2(pid=4645): Launched 11:55:29.477134 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:30.005689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Launched 11:55:30.303273 run osmo-stp_10.42.42.5(pid=4648): Launched 11:55:30.416903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:55:30.975326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4650): Launched 11:55:31.106615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:55:31.373802 run patchelf(pid=4651): Launched 11:55:31.551790 run osmo-stp_10.42.42.5(pid=4648): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)] 11:55:31.681149 run osmo-stp_10.42.42.5(pid=4648): stdout: | (launched: 2022-12-10_11:55:30.248909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:31.812033 run osmo-stp_10.42.42.5(pid=4648): stderr: | 20221210115530420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115530420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115530420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115530421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115530421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115530421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115530421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:31.943523 run osmo-stp_10.42.42.5(pid=4648): stdout: | (launched: 2022-12-10_11:55:30.248909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:32.068573 run osmo-stp_10.42.42.5(pid=4648): stderr: | 20221210115530420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115530420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115530420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115530421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115530421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115530421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115530421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:32.216681 run patchelf(pid=4651): Terminating (SIGINT) 11:55:32.383220 run patchelf(pid=4651): Terminated: ok {rc=0} 11:55:32.503486 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4648): Process ended prematurely: osmo-stp_10.42.42.5(pid=4648) [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)] [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27] 11:55:32.512350 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:55:32.539563 run osmo-hlr_10.42.42.2(pid=4645): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4645)] 11:55:32.587239 run osmo-hlr_10.42.42.2(pid=4645): stdout: | (launched: 2022-12-10_11:55:29.305767) 11:55:32.637245 run osmo-hlr_10.42.42.2(pid=4645): stderr: | 20221210115529481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115529481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115529481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115529482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115529482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115529482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115529493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115529504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115529504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115529504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:32.687182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Terminating (SIGTERM) 11:55:32.727060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Terminating (SIGTERM) 11:55:32.766938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4650): Terminating (SIGTERM) 11:55:32.807201 --- ParallelTerminationStrategy: PID 4644 died... 11:55:32.826306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Terminated: ok {rc=0} 11:55:32.870751 --- ParallelTerminationStrategy: PID 4647 died... 11:55:32.889189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Terminated: ok {rc=0} 11:55:32.933612 --- ParallelTerminationStrategy: PID 4650 died... 11:55:32.952229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4650): Terminated: ok {rc=0} 11:55:33.039040 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 11:55:34.333354 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:34.338937 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:55:34.371829 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:55:34.409890 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:55:34.495474 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:55:34.527487 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:55:34.565467 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:55:35.159967 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:55:35.211008 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.221787 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:55:35.269499 tst cs_paging_gprs_active.py: using LAC 28222 11:55:35.389578 tst cs_paging_gprs_active.py: using RAC 172 11:55:35.518252 tst cs_paging_gprs_active.py: using CellId 28222 11:55:35.646395 tst cs_paging_gprs_active.py: using BVCI 28223 11:55:35.764901 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.776370 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.787479 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.799216 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.810624 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.822149 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.834153 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.845551 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:35.857102 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:55:35.974030 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:55:36.092662 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:55:36.314506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:36.641289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4657): Launched 11:55:36.923792 run iperf3-srv_10.42.42.10(pid=4658): Launched 11:55:37.045462 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:55:37.264393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:37.590640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4659): Launched 11:55:37.873599 run iperf3-srv_10.42.42.10(pid=4660): Launched 11:55:37.995056 tst cs_paging_gprs_active.py:38: start network... 11:55:38.214057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:38.716249 run create_hlr_db(pid=4661): Launched 11:55:38.848138 bus /gobi_6: Setting Powered False 11:55:39.913246 run create_hlr_db(pid=4661): Terminated: ok {rc=0} 11:55:40.346747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4663): Launched 11:55:40.650095 run osmo-hlr_10.42.42.2(pid=4664): Launched 11:55:40.766909 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:41.301938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4666): Launched 11:55:41.605047 run osmo-stp_10.42.42.5(pid=4667): Launched 11:55:41.720829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:55:42.259264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4669): Launched 11:55:42.375811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:55:42.631171 run patchelf(pid=4670): Launched 11:55:42.799586 run osmo-stp_10.42.42.5(pid=4667): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4667)] 11:55:42.927989 run osmo-stp_10.42.42.5(pid=4667): stdout: | (launched: 2022-12-10_11:55:41.548863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:43.057873 run osmo-stp_10.42.42.5(pid=4667): stderr: | 20221210115541723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115541723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115541723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115541723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115541724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115541724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115541724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:43.188015 run osmo-stp_10.42.42.5(pid=4667): stdout: | (launched: 2022-12-10_11:55:41.548863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:43.311981 run osmo-stp_10.42.42.5(pid=4667): stderr: | 20221210115541723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115541723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115541723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115541723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115541724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115541724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115541724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:43.459160 run patchelf(pid=4670): Terminating (SIGINT) 11:55:43.629454 run patchelf(pid=4670): Terminated: ok {rc=0} 11:55:43.752379 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4667): Process ended prematurely: osmo-stp_10.42.42.5(pid=4667) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4667)] [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:55:43.761809 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:55:43.789462 run osmo-hlr_10.42.42.2(pid=4664): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4664)] 11:55:43.837429 run osmo-hlr_10.42.42.2(pid=4664): stdout: | (launched: 2022-12-10_11:55:40.594414) 11:55:43.886738 run osmo-hlr_10.42.42.2(pid=4664): stderr: | 20221210115540769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115540769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115540769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115540769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115540769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115540769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115540782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115540791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115540791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115540791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:43.936473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4657): Terminating (SIGTERM) 11:55:43.976197 run iperf3-srv_10.42.42.10(pid=4658): Terminating (SIGTERM) 11:55:44.015894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4659): Terminating (SIGTERM) 11:55:44.055987 run iperf3-srv_10.42.42.10(pid=4660): Terminating (SIGTERM) 11:55:44.095288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4663): Terminating (SIGTERM) 11:55:44.135394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4666): Terminating (SIGTERM) 11:55:44.174959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4669): Terminating (SIGTERM) 11:55:44.215037 --- ParallelTerminationStrategy: PID 4657 died... 11:55:44.234064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4657): Terminated: ok {rc=0} 11:55:44.278368 --- ParallelTerminationStrategy: PID 4658 died... 11:55:44.296708 run iperf3-srv_10.42.42.10(pid=4658): Terminated {rc=256} 11:55:44.340927 --- ParallelTerminationStrategy: PID 4659 died... 11:55:44.359492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4659): Terminated: ok {rc=0} 11:55:44.403469 --- ParallelTerminationStrategy: PID 4660 died... 11:55:44.422031 run iperf3-srv_10.42.42.10(pid=4660): Terminated {rc=256} 11:55:44.466041 --- ParallelTerminationStrategy: PID 4663 died... 11:55:44.484514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4663): Terminated: ok {rc=0} 11:55:44.528561 --- ParallelTerminationStrategy: PID 4666 died... 11:55:44.547188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4666): Terminated: ok {rc=0} 11:55:44.591500 --- ParallelTerminationStrategy: PID 4669 died... 11:55:44.610099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4669): Terminated: ok {rc=0} 11:55:44.696024 bus /gobi_0: Setting Powered False 11:55:45.795516 bus /gobi_0: Setting Powered False 11:55:46.927041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:55:48.082582 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.093968 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:55:48.145944 tst iperf3.py: using LAC 28223 11:55:48.265720 tst iperf3.py: using RAC 173 11:55:48.393074 tst iperf3.py: using CellId 28223 11:55:48.520052 tst iperf3.py: using BVCI 28224 11:55:48.638559 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.650113 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.661318 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.672476 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.683418 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.694438 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.705628 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.716490 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:48.727584 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:55:48.841982 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:55:49.046533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:49.349745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4671): Launched 11:55:49.613472 run iperf3-srv_10.42.42.10(pid=4672): Launched 11:55:49.727429 tst iperf3.py:8: start network... 11:55:49.930762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:50.397750 run create_hlr_db(pid=4673): Launched 11:55:50.513741 bus /gobi_6: Setting Powered False 11:55:51.573469 run create_hlr_db(pid=4673): Terminated: ok {rc=0} 11:55:51.993475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4675): Launched 11:55:52.294787 run osmo-hlr_10.42.42.2(pid=4676): Launched 11:55:52.410577 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:52.947109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4678): Launched 11:55:53.249490 run osmo-stp_10.42.42.5(pid=4679): Launched 11:55:53.365617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:55:53.886055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4681): Launched 11:55:54.001863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:55:54.256425 run patchelf(pid=4682): Launched 11:55:54.425271 run osmo-stp_10.42.42.5(pid=4679): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4679)] 11:55:54.552753 run osmo-stp_10.42.42.5(pid=4679): stdout: | (launched: 2022-12-10_11:55:53.194222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:54.682147 run osmo-stp_10.42.42.5(pid=4679): stderr: | 20221210115553366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115553366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115553367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115553367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115553367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115553367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115553368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:54.811610 run osmo-stp_10.42.42.5(pid=4679): stdout: | (launched: 2022-12-10_11:55:53.194222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:54.935312 run osmo-stp_10.42.42.5(pid=4679): stderr: | 20221210115553366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115553366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115553367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115553367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115553367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115553367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115553368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:55.081990 run patchelf(pid=4682): Terminating (SIGINT) 11:55:55.251734 run patchelf(pid=4682): Terminated: ok {rc=0} 11:55:55.373737 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4679): Process ended prematurely: osmo-stp_10.42.42.5(pid=4679) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4679)] [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 11:55:55.383005 tst iperf3.py:8: Test FAILED (7.3 sec) 11:55:55.410963 run osmo-hlr_10.42.42.2(pid=4676): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4676)] 11:55:55.458954 run osmo-hlr_10.42.42.2(pid=4676): stdout: | (launched: 2022-12-10_11:55:52.239694) 11:55:55.508834 run osmo-hlr_10.42.42.2(pid=4676): stderr: | 20221210115552415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115552415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115552415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115552415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115552415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115552415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115552427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115552435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115552435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115552435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:55.559282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4671): Terminating (SIGTERM) 11:55:55.599468 run iperf3-srv_10.42.42.10(pid=4672): Terminating (SIGTERM) 11:55:55.639559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4675): Terminating (SIGTERM) 11:55:55.679515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4678): Terminating (SIGTERM) 11:55:55.719916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4681): Terminating (SIGTERM) 11:55:55.760730 --- ParallelTerminationStrategy: PID 4671 died... 11:55:55.780373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4671): Terminated: ok {rc=0} 11:55:55.824920 --- ParallelTerminationStrategy: PID 4672 died... 11:55:55.843689 run iperf3-srv_10.42.42.10(pid=4672): Terminated {rc=256} 11:55:55.887992 --- ParallelTerminationStrategy: PID 4675 died... 11:55:55.906610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4675): Terminated: ok {rc=0} 11:55:55.950784 --- ParallelTerminationStrategy: PID 4678 died... 11:55:55.969446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4678): Terminated: ok {rc=0} 11:55:56.013613 --- ParallelTerminationStrategy: PID 4681 died... 11:55:56.032168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4681): Terminated: ok {rc=0} 11:55:56.116575 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:55:57.266289 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.278202 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:55:57.332841 tst iperf3m4.py: using LAC 28224 11:55:57.461039 tst iperf3m4.py: using RAC 174 11:55:57.585831 tst iperf3m4.py: using CellId 28224 11:55:57.710236 tst iperf3m4.py: using BVCI 28225 11:55:57.821898 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.832875 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.843619 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.855163 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.866586 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.877828 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.889250 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.900309 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:55:57.911582 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:55:58.031480 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:55:58.149130 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:55:58.268098 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:55:58.386806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:55:58.606325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:58.931925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4683): Launched 11:55:59.214350 run iperf3-srv_10.42.42.10(pid=4684): Launched 11:55:59.336414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:55:59.547041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:59.851859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4685): Launched 11:56:00.114716 run iperf3-srv_10.42.42.10(pid=4686): Launched 11:56:00.228037 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:56:00.430800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:00.733752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4687): Launched 11:56:01.058879 run iperf3-srv_10.42.42.10(pid=4688): Launched 11:56:01.229855 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:56:01.512240 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:01.867121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4689): Launched 11:56:02.254547 run iperf3-srv_10.42.42.10(pid=4690): Launched 11:56:02.385257 tst iperf3m4.py:8: start network... 11:56:02.604052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:03.106507 run create_hlr_db(pid=4691): Launched 11:56:03.237851 bus /gobi_6: Setting Powered False 11:56:04.301160 run create_hlr_db(pid=4691): Terminated: ok {rc=0} 11:56:04.733885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4693): Launched 11:56:05.037306 run osmo-hlr_10.42.42.2(pid=4694): Launched 11:56:05.152656 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:05.690450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4696): Launched 11:56:05.994374 run osmo-stp_10.42.42.5(pid=4697): Launched 11:56:06.110113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:06.629700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Launched 11:56:06.746433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:07.002839 run patchelf(pid=4700): Launched 11:56:07.171946 run osmo-stp_10.42.42.5(pid=4697): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4697)] 11:56:07.300375 run osmo-stp_10.42.42.5(pid=4697): stdout: | (launched: 2022-12-10_11:56:05.938665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:07.430321 run osmo-stp_10.42.42.5(pid=4697): stderr: | 20221210115606109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115606109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115606109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115606110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115606110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115606110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115606110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:07.560265 run osmo-stp_10.42.42.5(pid=4697): stdout: | (launched: 2022-12-10_11:56:05.938665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:07.684230 run osmo-stp_10.42.42.5(pid=4697): stderr: | 20221210115606109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115606109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115606109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115606110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115606110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115606110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115606110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:07.832152 run patchelf(pid=4700): Terminating (SIGINT) 11:56:08.002625 run patchelf(pid=4700): Terminated: ok {rc=0} 11:56:08.125547 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4697): Process ended prematurely: osmo-stp_10.42.42.5(pid=4697) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4697)] [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 11:56:08.134977 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:56:08.163043 run osmo-hlr_10.42.42.2(pid=4694): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4694)] 11:56:08.211080 run osmo-hlr_10.42.42.2(pid=4694): stdout: | (launched: 2022-12-10_11:56:04.981962) 11:56:08.260547 run osmo-hlr_10.42.42.2(pid=4694): stderr: | 20221210115605156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115605156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115605156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115605156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115605157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115605157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115605169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115605177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115605178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115605178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:08.310519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4683): Terminating (SIGTERM) 11:56:08.350555 run iperf3-srv_10.42.42.10(pid=4684): Terminating (SIGTERM) 11:56:08.390633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4685): Terminating (SIGTERM) 11:56:08.430848 run iperf3-srv_10.42.42.10(pid=4686): Terminating (SIGTERM) 11:56:08.471162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4687): Terminating (SIGTERM) 11:56:08.511394 run iperf3-srv_10.42.42.10(pid=4688): Terminating (SIGTERM) 11:56:08.551527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4689): Terminating (SIGTERM) 11:56:08.591666 run iperf3-srv_10.42.42.10(pid=4690): Terminating (SIGTERM) 11:56:08.631726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4693): Terminating (SIGTERM) 11:56:08.671410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4696): Terminating (SIGTERM) 11:56:08.711753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Terminating (SIGTERM) 11:56:08.752139 --- ParallelTerminationStrategy: PID 4683 died... 11:56:08.771260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4683): Terminated: ok {rc=0} 11:56:08.816042 --- ParallelTerminationStrategy: PID 4684 died... 11:56:08.834810 run iperf3-srv_10.42.42.10(pid=4684): Terminated {rc=256} 11:56:08.879703 --- ParallelTerminationStrategy: PID 4685 died... 11:56:08.898589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4685): Terminated: ok {rc=0} 11:56:08.943066 --- ParallelTerminationStrategy: PID 4686 died... 11:56:08.961606 run iperf3-srv_10.42.42.10(pid=4686): Terminated {rc=256} 11:56:09.006482 --- ParallelTerminationStrategy: PID 4687 died... 11:56:09.025274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4687): Terminated: ok {rc=0} 11:56:09.069629 --- ParallelTerminationStrategy: PID 4688 died... 11:56:09.088210 run iperf3-srv_10.42.42.10(pid=4688): Terminated {rc=256} 11:56:09.132436 --- ParallelTerminationStrategy: PID 4689 died... 11:56:09.150941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4689): Terminated: ok {rc=0} 11:56:09.195163 --- ParallelTerminationStrategy: PID 4690 died... 11:56:09.213911 run iperf3-srv_10.42.42.10(pid=4690): Terminated {rc=256} 11:56:09.258606 --- ParallelTerminationStrategy: PID 4693 died... 11:56:09.277456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4693): Terminated: ok {rc=0} 11:56:09.321778 --- ParallelTerminationStrategy: PID 4696 died... 11:56:09.340569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4696): Terminated: ok {rc=0} 11:56:09.384578 --- ParallelTerminationStrategy: PID 4699 died... 11:56:09.403356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Terminated: ok {rc=0} 11:56:09.489043 bus /gobi_4: Setting Powered False 11:56:10.587770 bus /gobi_4: Setting Powered False 11:56:11.703584 bus /gobi_1: Setting Powered False 11:56:12.801417 bus /gobi_1: Setting Powered False 11:56:13.917002 bus /gobi_0: Setting Powered False 11:56:15.014834 bus /gobi_0: Setting Powered False 11:56:16.142991 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 11:56:17.260897 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.272262 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:56:17.321511 tst ping.py: using LAC 28225 11:56:17.442583 tst ping.py: using RAC 175 11:56:17.558269 tst ping.py: using CellId 28225 11:56:17.674621 tst ping.py: using BVCI 28226 11:56:17.781866 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.792620 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.803256 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.814039 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.824837 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.835507 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.846483 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:17.857296 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:17.970045 tst ping.py:19: start network... 11:56:18.169727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:18.630705 run create_hlr_db(pid=4701): Launched 11:56:18.745278 bus /gobi_6: Setting Powered False 11:56:19.805167 run create_hlr_db(pid=4701): Terminated: ok {rc=0} 11:56:20.242638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Launched 11:56:20.562628 run osmo-hlr_10.42.42.2(pid=4704): Launched 11:56:20.686068 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:21.235378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Launched 11:56:21.552565 run osmo-stp_10.42.42.5(pid=4707): Launched 11:56:21.674243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:22.223155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Launched 11:56:22.344766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:22.612406 run patchelf(pid=4710): Launched 11:56:22.788197 run osmo-stp_10.42.42.5(pid=4707): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] 11:56:22.922287 run osmo-stp_10.42.42.5(pid=4707): stdout: | (launched: 2022-12-10_11:56:21.494620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:23.057943 run osmo-stp_10.42.42.5(pid=4707): stderr: | 20221210115621688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115621688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115621688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115621689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115621689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115621690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115621690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:23.193581 run osmo-stp_10.42.42.5(pid=4707): stdout: | (launched: 2022-12-10_11:56:21.494620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:23.323113 run osmo-stp_10.42.42.5(pid=4707): stderr: | 20221210115621688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115621688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115621688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115621689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115621689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115621690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115621690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:23.476344 run patchelf(pid=4710): Terminating (SIGINT) 11:56:23.653554 run patchelf(pid=4710): Terminated: ok {rc=0} 11:56:23.781249 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4707): Process ended prematurely: osmo-stp_10.42.42.5(pid=4707) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 11:56:23.790652 tst ping.py:22: Test FAILED (6.5 sec) 11:56:23.818665 run osmo-hlr_10.42.42.2(pid=4704): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4704)] 11:56:23.868744 run osmo-hlr_10.42.42.2(pid=4704): stdout: | (launched: 2022-12-10_11:56:20.504354) 11:56:23.920324 run osmo-hlr_10.42.42.2(pid=4704): stderr: | 20221210115620702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115620702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115620703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115620703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115620703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115620703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115620714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115620722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115620723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115620723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:23.972438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Terminating (SIGTERM) 11:56:24.013869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Terminating (SIGTERM) 11:56:24.055650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Terminating (SIGTERM) 11:56:24.097718 --- ParallelTerminationStrategy: PID 4703 died... 11:56:24.117730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Terminated: ok {rc=0} 11:56:24.164247 --- ParallelTerminationStrategy: PID 4706 died... 11:56:24.184037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Terminated: ok {rc=0} 11:56:24.229994 --- ParallelTerminationStrategy: PID 4709 died... 11:56:24.249693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Terminated: ok {rc=0} 11:56:24.337682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:56:25.426011 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:25.438304 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:56:25.490951 tst ping_idle_ping.py: using LAC 28226 11:56:25.616719 tst ping_idle_ping.py: using RAC 176 11:56:25.741407 tst ping_idle_ping.py: using CellId 28226 11:56:25.865702 tst ping_idle_ping.py: using BVCI 28227 11:56:25.981692 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:25.993149 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:26.004251 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:26.015485 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:26.026689 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:26.037701 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:26.048816 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:26.059848 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:26.176550 tst ping_idle_ping.py:24: start network... 11:56:26.391653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:26.887302 run create_hlr_db(pid=4711): Launched 11:56:27.017376 bus /gobi_6: Setting Powered False 11:56:28.080829 run create_hlr_db(pid=4711): Terminated: ok {rc=0} 11:56:28.506901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4713): Launched 11:56:28.805764 run osmo-hlr_10.42.42.2(pid=4714): Launched 11:56:28.919299 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:29.447697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4716): Launched 11:56:29.746670 run osmo-stp_10.42.42.5(pid=4717): Launched 11:56:29.861124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:30.376053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4719): Launched 11:56:30.490926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:30.742865 run patchelf(pid=4720): Launched 11:56:30.923076 run osmo-stp_10.42.42.5(pid=4717): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4717)] 11:56:31.053143 run osmo-stp_10.42.42.5(pid=4717): stdout: | (launched: 2022-12-10_11:56:29.691805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:31.184716 run osmo-stp_10.42.42.5(pid=4717): stderr: | 20221210115629862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115629862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115629863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115629863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115629863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115629863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115629863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:31.316411 run osmo-stp_10.42.42.5(pid=4717): stdout: | (launched: 2022-12-10_11:56:29.691805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:31.442611 run osmo-stp_10.42.42.5(pid=4717): stderr: | 20221210115629862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115629862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115629863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115629863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115629863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115629863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115629863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:31.591645 run patchelf(pid=4720): Terminating (SIGINT) 11:56:31.763768 run patchelf(pid=4720): Terminated: ok {rc=0} 11:56:31.888547 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4717): Process ended prematurely: osmo-stp_10.42.42.5(pid=4717) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4717)] [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 11:56:31.898603 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:56:31.929393 run osmo-hlr_10.42.42.2(pid=4714): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4714)] 11:56:31.980171 run osmo-hlr_10.42.42.2(pid=4714): stdout: | (launched: 2022-12-10_11:56:28.751391) 11:56:32.032451 run osmo-hlr_10.42.42.2(pid=4714): stderr: | 20221210115628928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115628928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115628928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115628928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115628928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115628928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115628941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115628951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115628951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115628951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:32.085448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4713): Terminating (SIGTERM) 11:56:32.128295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4716): Terminating (SIGTERM) 11:56:32.172131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4719): Terminating (SIGTERM) 11:56:32.215109 --- ParallelTerminationStrategy: PID 4713 died... 11:56:32.234443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4713): Terminated: ok {rc=0} 11:56:32.280251 --- ParallelTerminationStrategy: PID 4716 died... 11:56:32.298860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4716): Terminated: ok {rc=0} 11:56:32.344632 --- ParallelTerminationStrategy: PID 4719 died... 11:56:32.363418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4719): Terminated: ok {rc=0} 11:56:32.448432 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:56:33.754173 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:33.761232 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:56:33.794863 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:56:33.833958 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:56:33.921993 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:56:33.955243 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:56:33.994657 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:56:34.587933 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:56:34.640893 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:34.651759 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:56:34.720319 tst cs_paging_gprs_active.py: using LAC 28227 11:56:34.838985 tst cs_paging_gprs_active.py: using RAC 177 11:56:34.959048 tst cs_paging_gprs_active.py: using CellId 28227 11:56:35.084220 tst cs_paging_gprs_active.py: using BVCI 28228 11:56:35.206111 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.217574 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.228753 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.240630 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.253028 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.264909 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.276324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.288103 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:35.300013 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:56:35.421286 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:56:35.538406 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:56:35.743815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:36.049860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4724): Launched 11:56:36.314857 run iperf3-srv_10.42.42.10(pid=4725): Launched 11:56:36.429242 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:56:36.632303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:36.936802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4726): Launched 11:56:37.200345 run iperf3-srv_10.42.42.10(pid=4727): Launched 11:56:37.314350 tst cs_paging_gprs_active.py:38: start network... 11:56:37.517550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:37.986779 run create_hlr_db(pid=4728): Launched 11:56:38.102570 bus /gobi_6: Setting Powered False 11:56:39.163156 run create_hlr_db(pid=4728): Terminated: ok {rc=0} 11:56:39.605707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4730): Launched 11:56:39.930896 run osmo-hlr_10.42.42.2(pid=4731): Launched 11:56:40.054629 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:40.610199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4733): Launched 11:56:40.934103 run osmo-stp_10.42.42.5(pid=4734): Launched 11:56:41.057457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:41.614232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4736): Launched 11:56:41.738790 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:42.019193 run patchelf(pid=4737): Launched 11:56:42.200170 run osmo-stp_10.42.42.5(pid=4734): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4734)] 11:56:42.337568 run osmo-stp_10.42.42.5(pid=4734): stdout: | (launched: 2022-12-10_11:56:40.875043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:42.475960 run osmo-stp_10.42.42.5(pid=4734): stderr: | 20221210115641067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115641067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115641067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115641068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115641068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115641068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115641068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:42.614497 run osmo-stp_10.42.42.5(pid=4734): stdout: | (launched: 2022-12-10_11:56:40.875043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:42.748094 run osmo-stp_10.42.42.5(pid=4734): stderr: | 20221210115641067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115641067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115641067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115641068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115641068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115641068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115641068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:42.905577 run patchelf(pid=4737): Terminating (SIGINT) 11:56:43.086730 run patchelf(pid=4737): Terminated: ok {rc=0} 11:56:43.217376 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4734): Process ended prematurely: osmo-stp_10.42.42.5(pid=4734) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4734)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:56:43.227419 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:56:43.255768 run osmo-hlr_10.42.42.2(pid=4731): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4731)] 11:56:43.305242 run osmo-hlr_10.42.42.2(pid=4731): stdout: | (launched: 2022-12-10_11:56:39.871939) 11:56:43.356376 run osmo-hlr_10.42.42.2(pid=4731): stderr: | 20221210115640071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115640071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115640071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115640071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115640071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115640071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115640084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115640092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115640092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115640092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:43.408059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4724): Terminating (SIGTERM) 11:56:43.449588 run iperf3-srv_10.42.42.10(pid=4725): Terminating (SIGTERM) 11:56:43.490982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4726): Terminating (SIGTERM) 11:56:43.532522 run iperf3-srv_10.42.42.10(pid=4727): Terminating (SIGTERM) 11:56:43.573851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4730): Terminating (SIGTERM) 11:56:43.615339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4733): Terminating (SIGTERM) 11:56:43.656727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4736): Terminating (SIGTERM) 11:56:43.698525 --- ParallelTerminationStrategy: PID 4724 died... 11:56:43.718166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4724): Terminated: ok {rc=0} 11:56:43.764503 --- ParallelTerminationStrategy: PID 4725 died... 11:56:43.783952 run iperf3-srv_10.42.42.10(pid=4725): Terminated {rc=256} 11:56:43.829502 --- ParallelTerminationStrategy: PID 4726 died... 11:56:43.848832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4726): Terminated: ok {rc=0} 11:56:43.894978 --- ParallelTerminationStrategy: PID 4727 died... 11:56:43.914651 run iperf3-srv_10.42.42.10(pid=4727): Terminated {rc=256} 11:56:43.960270 --- ParallelTerminationStrategy: PID 4730 died... 11:56:43.979798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4730): Terminated: ok {rc=0} 11:56:44.025585 --- ParallelTerminationStrategy: PID 4733 died... 11:56:44.045120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4733): Terminated: ok {rc=0} 11:56:44.091278 --- ParallelTerminationStrategy: PID 4736 died... 11:56:44.111043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4736): Terminated: ok {rc=0} 11:56:44.197378 bus /gobi_0: Setting Powered False 11:56:45.296575 bus /gobi_0: Setting Powered False 11:56:46.414076 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:56:47.558662 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:47.570131 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:56:47.638501 tst iperf3.py: using LAC 28228 11:56:47.756061 tst iperf3.py: using RAC 178 11:56:47.875229 tst iperf3.py: using CellId 28228 11:56:47.996400 tst iperf3.py: using BVCI 28229 11:56:48.115977 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.127518 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.138838 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.150495 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.162169 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.173839 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.185519 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.196905 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:48.208646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:56:48.325905 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:56:48.530171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:48.833364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4738): Launched 11:56:49.097540 run iperf3-srv_10.42.42.10(pid=4739): Launched 11:56:49.211525 tst iperf3.py:8: start network... 11:56:49.415416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:49.883099 run create_hlr_db(pid=4740): Launched 11:56:49.999076 bus /gobi_6: Setting Powered False 11:56:51.059245 run create_hlr_db(pid=4740): Terminated: ok {rc=0} 11:56:51.501154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4742): Launched 11:56:51.824874 run osmo-hlr_10.42.42.2(pid=4743): Launched 11:56:51.949060 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:52.600537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4745): Launched 11:56:52.917046 run osmo-stp_10.42.42.5(pid=4746): Launched 11:56:53.037678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:53.585514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4748): Launched 11:56:53.706852 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:53.975109 run patchelf(pid=4749): Launched 11:56:54.151275 run osmo-stp_10.42.42.5(pid=4746): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4746)] 11:56:54.285775 run osmo-stp_10.42.42.5(pid=4746): stdout: | (launched: 2022-12-10_11:56:52.858976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:54.421250 run osmo-stp_10.42.42.5(pid=4746): stderr: | 20221210115653050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115653050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115653050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115653050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115653051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115653051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115653051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:54.557040 run osmo-stp_10.42.42.5(pid=4746): stdout: | (launched: 2022-12-10_11:56:52.858976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:54.686753 run osmo-stp_10.42.42.5(pid=4746): stderr: | 20221210115653050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115653050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115653050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115653050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115653051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115653051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115653051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:54.840538 run patchelf(pid=4749): Terminating (SIGINT) 11:56:55.018410 run patchelf(pid=4749): Terminated: ok {rc=0} 11:56:55.145906 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4746): Process ended prematurely: osmo-stp_10.42.42.5(pid=4746) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4746)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 11:56:55.155748 tst iperf3.py:8: Test FAILED (7.6 sec) 11:56:55.184074 run osmo-hlr_10.42.42.2(pid=4743): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4743)] 11:56:55.233178 run osmo-hlr_10.42.42.2(pid=4743): stdout: | (launched: 2022-12-10_11:56:51.766141) 11:56:55.283866 run osmo-hlr_10.42.42.2(pid=4743): stderr: | 20221210115651967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115651967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115651967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115651967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115651967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115651967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115651979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115651989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115651989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115651990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:55.335162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4738): Terminating (SIGTERM) 11:56:55.376230 run iperf3-srv_10.42.42.10(pid=4739): Terminating (SIGTERM) 11:56:55.417366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4742): Terminating (SIGTERM) 11:56:55.458419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4745): Terminating (SIGTERM) 11:56:55.499367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4748): Terminating (SIGTERM) 11:56:55.540816 --- ParallelTerminationStrategy: PID 4738 died... 11:56:55.560489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4738): Terminated: ok {rc=0} 11:56:55.606205 --- ParallelTerminationStrategy: PID 4739 died... 11:56:55.625665 run iperf3-srv_10.42.42.10(pid=4739): Terminated {rc=256} 11:56:55.670991 --- ParallelTerminationStrategy: PID 4742 died... 11:56:55.690426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4742): Terminated: ok {rc=0} 11:56:55.735589 --- ParallelTerminationStrategy: PID 4745 died... 11:56:55.754675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4745): Terminated: ok {rc=0} 11:56:55.799848 --- ParallelTerminationStrategy: PID 4748 died... 11:56:55.819021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4748): Terminated: ok {rc=0} 11:56:55.904516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:56:57.049695 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.061304 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:56:57.132282 tst iperf3m4.py: using LAC 28229 11:56:57.247309 tst iperf3m4.py: using RAC 179 11:56:57.362621 tst iperf3m4.py: using CellId 28229 11:56:57.481951 tst iperf3m4.py: using BVCI 28230 11:56:57.591763 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.602719 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.613410 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.624234 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.635021 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.645995 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.657025 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.667653 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:56:57.678926 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:56:57.795856 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:56:57.913889 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:56:58.033348 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:56:58.148137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:56:58.348151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:58.645251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4750): Launched 11:56:58.903363 run iperf3-srv_10.42.42.10(pid=4751): Launched 11:56:59.015051 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:56:59.213086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:59.510763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4752): Launched 11:56:59.768845 run iperf3-srv_10.42.42.10(pid=4753): Launched 11:56:59.880379 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:57:00.078851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:00.376307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4754): Launched 11:57:00.634276 run iperf3-srv_10.42.42.10(pid=4755): Launched 11:57:00.745639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:57:00.967300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:01.278194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4756): Launched 11:57:01.559147 run iperf3-srv_10.42.42.10(pid=4757): Launched 11:57:01.717189 tst iperf3m4.py:8: start network... 11:57:01.948454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:02.457213 run create_hlr_db(pid=4758): Launched 11:57:02.572847 bus /gobi_6: Setting Powered False 11:57:03.632370 run create_hlr_db(pid=4758): Terminated: ok {rc=0} 11:57:04.046225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4760): Launched 11:57:04.343663 run osmo-hlr_10.42.42.2(pid=4761): Launched 11:57:04.456467 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:04.965320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4763): Launched 11:57:05.262309 run osmo-stp_10.42.42.5(pid=4764): Launched 11:57:05.375849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:05.887730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4766): Launched 11:57:06.001685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:06.253202 run patchelf(pid=4767): Launched 11:57:06.419100 run osmo-stp_10.42.42.5(pid=4764): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4764)] 11:57:06.545367 run osmo-stp_10.42.42.5(pid=4764): stdout: | (launched: 2022-12-10_11:57:05.207774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:06.673282 run osmo-stp_10.42.42.5(pid=4764): stderr: | 20221210115705379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115705379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115705379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115705380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115705380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115705380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115705380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:06.800908 run osmo-stp_10.42.42.5(pid=4764): stdout: | (launched: 2022-12-10_11:57:05.207774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:06.923413 run osmo-stp_10.42.42.5(pid=4764): stderr: | 20221210115705379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115705379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115705379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115705380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115705380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115705380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115705380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:07.067834 run patchelf(pid=4767): Terminating (SIGINT) 11:57:07.235290 run patchelf(pid=4767): Terminated: ok {rc=0} 11:57:07.356182 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4764): Process ended prematurely: osmo-stp_10.42.42.5(pid=4764) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4764)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:57:07.365940 tst iperf3m4.py:8: Test FAILED (10.4 sec) 11:57:07.393759 run osmo-hlr_10.42.42.2(pid=4761): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4761)] 11:57:07.442047 run osmo-hlr_10.42.42.2(pid=4761): stdout: | (launched: 2022-12-10_11:57:04.289491) 11:57:07.491500 run osmo-hlr_10.42.42.2(pid=4761): stderr: | 20221210115704464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115704464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115704464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115704464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115704464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115704464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115704481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115704490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115704490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115704490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:07.541366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4750): Terminating (SIGTERM) 11:57:07.581184 run iperf3-srv_10.42.42.10(pid=4751): Terminating (SIGTERM) 11:57:07.620771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4752): Terminating (SIGTERM) 11:57:07.660563 run iperf3-srv_10.42.42.10(pid=4753): Terminating (SIGTERM) 11:57:07.700383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4754): Terminating (SIGTERM) 11:57:07.740108 run iperf3-srv_10.42.42.10(pid=4755): Terminating (SIGTERM) 11:57:07.779268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4756): Terminating (SIGTERM) 11:57:07.819569 run iperf3-srv_10.42.42.10(pid=4757): Terminating (SIGTERM) 11:57:07.859279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4760): Terminating (SIGTERM) 11:57:07.899075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4763): Terminating (SIGTERM) 11:57:07.938896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4766): Terminating (SIGTERM) 11:57:07.978924 --- ParallelTerminationStrategy: PID 4750 died... 11:57:07.997861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4750): Terminated: ok {rc=0} 11:57:08.042354 --- ParallelTerminationStrategy: PID 4751 died... 11:57:08.060711 run iperf3-srv_10.42.42.10(pid=4751): Terminated {rc=256} 11:57:08.105111 --- ParallelTerminationStrategy: PID 4752 died... 11:57:08.123481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4752): Terminated: ok {rc=0} 11:57:08.167815 --- ParallelTerminationStrategy: PID 4753 died... 11:57:08.186477 run iperf3-srv_10.42.42.10(pid=4753): Terminated {rc=256} 11:57:08.230850 --- ParallelTerminationStrategy: PID 4754 died... 11:57:08.249375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4754): Terminated: ok {rc=0} 11:57:08.294110 --- ParallelTerminationStrategy: PID 4755 died... 11:57:08.312755 run iperf3-srv_10.42.42.10(pid=4755): Terminated {rc=256} 11:57:08.357216 --- ParallelTerminationStrategy: PID 4756 died... 11:57:08.375688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4756): Terminated: ok {rc=0} 11:57:08.420364 --- ParallelTerminationStrategy: PID 4757 died... 11:57:08.439077 run iperf3-srv_10.42.42.10(pid=4757): Terminated {rc=256} 11:57:08.483617 --- ParallelTerminationStrategy: PID 4760 died... 11:57:08.502274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4760): Terminated: ok {rc=0} 11:57:08.546697 --- ParallelTerminationStrategy: PID 4763 died... 11:57:08.565373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4763): Terminated: ok {rc=0} 11:57:08.609985 --- ParallelTerminationStrategy: PID 4766 died... 11:57:08.628623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4766): Terminated: ok {rc=0} 11:57:08.716041 bus /gobi_4: Setting Powered False 11:57:09.816113 bus /gobi_4: Setting Powered False 11:57:10.932525 bus /gobi_1: Setting Powered False 11:57:12.031460 bus /gobi_1: Setting Powered False 11:57:13.144374 bus /gobi_0: Setting Powered False 11:57:14.242476 bus /gobi_0: Setting Powered False 11:57:15.357749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:57:16.470864 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:16.487525 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:57:16.576553 tst ping.py: using LAC 28230 11:57:16.694708 tst ping.py: using RAC 180 11:57:16.869718 tst ping.py: using CellId 28230 11:57:16.987661 tst ping.py: using BVCI 28231 11:57:17.138794 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:17.150629 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:17.163662 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:17.176336 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:17.187862 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:17.200597 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:17.214427 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:17.227051 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:17.344144 tst ping.py:19: start network... 11:57:17.541611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:17.998843 run create_hlr_db(pid=4768): Launched 11:57:18.112350 bus /gobi_6: Setting Powered False 11:57:19.171613 run create_hlr_db(pid=4768): Terminated: ok {rc=0} 11:57:19.603985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4770): Launched 11:57:19.918545 run osmo-hlr_10.42.42.2(pid=4771): Launched 11:57:20.039287 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:20.584461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4773): Launched 11:57:20.898548 run osmo-stp_10.42.42.5(pid=4774): Launched 11:57:21.017809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:21.558190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4776): Launched 11:57:21.677575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:21.942508 run patchelf(pid=4777): Launched 11:57:22.116598 run osmo-stp_10.42.42.5(pid=4774): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4774)] 11:57:22.249360 run osmo-stp_10.42.42.5(pid=4774): stdout: | (launched: 2022-12-10_11:57:20.841146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:22.384018 run osmo-stp_10.42.42.5(pid=4774): stderr: | 20221210115721032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115721032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115721032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115721032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115721035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115721035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115721035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:22.518885 run osmo-stp_10.42.42.5(pid=4774): stdout: | (launched: 2022-12-10_11:57:20.841146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:22.647559 run osmo-stp_10.42.42.5(pid=4774): stderr: | 20221210115721032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115721032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115721032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115721032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115721035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115721035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115721035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:22.800117 run patchelf(pid=4777): Terminating (SIGINT) 11:57:22.976091 run patchelf(pid=4777): Terminated: ok {rc=0} 11:57:23.102374 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4774): Process ended prematurely: osmo-stp_10.42.42.5(pid=4774) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4774)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 11:57:23.111879 tst ping.py:22: Test FAILED (6.6 sec) 11:57:23.140299 run osmo-hlr_10.42.42.2(pid=4771): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4771)] 11:57:23.190458 run osmo-hlr_10.42.42.2(pid=4771): stdout: | (launched: 2022-12-10_11:57:19.861141) 11:57:23.241983 run osmo-hlr_10.42.42.2(pid=4771): stderr: | 20221210115720056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115720056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115720056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115720056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115720056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115720056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115720069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115720078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115720078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115720078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:23.294185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4770): Terminating (SIGTERM) 11:57:23.336328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4773): Terminating (SIGTERM) 11:57:23.378485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4776): Terminating (SIGTERM) 11:57:23.420755 --- ParallelTerminationStrategy: PID 4770 died... 11:57:23.440382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4770): Terminated: ok {rc=0} 11:57:23.486665 --- ParallelTerminationStrategy: PID 4773 died... 11:57:23.506144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4773): Terminated: ok {rc=0} 11:57:23.551997 --- ParallelTerminationStrategy: PID 4776 died... 11:57:23.571505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4776): Terminated: ok {rc=0} 11:57:23.661200 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:57:24.749318 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:24.761768 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:57:24.840689 tst ping_idle_ping.py: using LAC 28231 11:57:24.964022 tst ping_idle_ping.py: using RAC 181 11:57:25.085294 tst ping_idle_ping.py: using CellId 28231 11:57:25.205347 tst ping_idle_ping.py: using BVCI 28232 11:57:25.314567 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:25.325553 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:25.336347 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:25.347538 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:25.358754 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:25.369987 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:25.381454 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:25.392306 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:25.505518 tst ping_idle_ping.py:24: start network... 11:57:25.702973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:26.157992 run create_hlr_db(pid=4778): Launched 11:57:26.270562 bus /gobi_6: Setting Powered False 11:57:27.329352 run create_hlr_db(pid=4778): Terminated: ok {rc=0} 11:57:27.760133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4780): Launched 11:57:28.075137 run osmo-hlr_10.42.42.2(pid=4781): Launched 11:57:28.195481 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:28.739977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4783): Launched 11:57:29.055978 run osmo-stp_10.42.42.5(pid=4784): Launched 11:57:29.176311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:29.718038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4786): Launched 11:57:29.837902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:30.103024 run patchelf(pid=4787): Launched 11:57:30.277341 run osmo-stp_10.42.42.5(pid=4784): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4784)] 11:57:30.410784 run osmo-stp_10.42.42.5(pid=4784): stdout: | (launched: 2022-12-10_11:57:28.998378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:30.545964 run osmo-stp_10.42.42.5(pid=4784): stderr: | 20221210115729189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115729189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115729189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115729189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115729190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115729190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115729190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:30.680756 run osmo-stp_10.42.42.5(pid=4784): stdout: | (launched: 2022-12-10_11:57:28.998378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:30.810099 run osmo-stp_10.42.42.5(pid=4784): stderr: | 20221210115729189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115729189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115729189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115729189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115729190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115729190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115729190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:30.977218 run patchelf(pid=4787): Terminating (SIGINT) 11:57:31.151485 run patchelf(pid=4787): Terminated: ok {rc=0} 11:57:31.275115 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4784): Process ended prematurely: osmo-stp_10.42.42.5(pid=4784) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4784)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:57:31.285234 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:57:31.316348 run osmo-hlr_10.42.42.2(pid=4781): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4781)] 11:57:31.367583 run osmo-hlr_10.42.42.2(pid=4781): stdout: | (launched: 2022-12-10_11:57:28.017749) 11:57:31.419807 run osmo-hlr_10.42.42.2(pid=4781): stderr: | 20221210115728214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115728214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115728214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115728214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115728214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115728214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115728226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115728235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115728235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115728235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:31.472280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4780): Terminating (SIGTERM) 11:57:31.515949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4783): Terminating (SIGTERM) 11:57:31.560876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4786): Terminating (SIGTERM) 11:57:31.605648 --- ParallelTerminationStrategy: PID 4780 died... 11:57:31.625616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4780): Terminated: ok {rc=0} 11:57:31.675500 --- ParallelTerminationStrategy: PID 4783 died... 11:57:31.694993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4783): Terminated: ok {rc=0} 11:57:31.742514 --- ParallelTerminationStrategy: PID 4786 died... 11:57:31.761564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4786): Terminated: ok {rc=0} 11:57:31.849124 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:57:33.160011 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:57:33.166939 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:57:33.200631 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:57:33.239878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:57:33.327807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:57:33.361213 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:57:33.400488 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:57:33.997196 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:57:34.049077 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.060420 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:57:34.134263 tst cs_paging_gprs_active.py: using LAC 28232 11:57:34.259950 tst cs_paging_gprs_active.py: using RAC 182 11:57:34.383531 tst cs_paging_gprs_active.py: using CellId 28232 11:57:34.506752 tst cs_paging_gprs_active.py: using BVCI 28233 11:57:34.624267 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.635607 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.646707 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.657970 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.669136 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.680450 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.691836 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.702960 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:34.714569 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:57:34.832683 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:57:34.956036 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:57:35.172806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:35.494165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4791): Launched 11:57:35.772564 run iperf3-srv_10.42.42.10(pid=4792): Launched 11:57:35.893338 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:57:36.105926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:36.407817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4796): Launched 11:57:36.670361 run iperf3-srv_10.42.42.10(pid=4797): Launched 11:57:36.783021 tst cs_paging_gprs_active.py:38: start network... 11:57:36.983015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:37.445583 run create_hlr_db(pid=4798): Launched 11:57:37.576656 bus /gobi_6: Setting Powered False 11:57:38.640161 run create_hlr_db(pid=4798): Terminated: ok {rc=0} 11:57:39.067839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Launched 11:57:39.367538 run osmo-hlr_10.42.42.2(pid=4801): Launched 11:57:39.481975 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:39.998435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Launched 11:57:40.297764 run osmo-stp_10.42.42.5(pid=4804): Launched 11:57:40.413141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:40.928173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4806): Launched 11:57:41.043869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:41.297701 run patchelf(pid=4807): Launched 11:57:41.464186 run osmo-stp_10.42.42.5(pid=4804): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] 11:57:41.590665 run osmo-stp_10.42.42.5(pid=4804): stdout: | (launched: 2022-12-10_11:57:40.242916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:41.718240 run osmo-stp_10.42.42.5(pid=4804): stderr: | 20221210115740415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115740416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115740416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115740416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115740417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115740417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115740417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:41.846307 run osmo-stp_10.42.42.5(pid=4804): stdout: | (launched: 2022-12-10_11:57:40.242916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:41.969023 run osmo-stp_10.42.42.5(pid=4804): stderr: | 20221210115740415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115740416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115740416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115740416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115740417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115740417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115740417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:42.114306 run patchelf(pid=4807): Terminating (SIGINT) 11:57:42.281951 run patchelf(pid=4807): Terminated: ok {rc=0} 11:57:42.403241 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4804): Process ended prematurely: osmo-stp_10.42.42.5(pid=4804) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:57:42.412765 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 11:57:42.440165 run osmo-hlr_10.42.42.2(pid=4801): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4801)] 11:57:42.487525 run osmo-hlr_10.42.42.2(pid=4801): stdout: | (launched: 2022-12-10_11:57:39.313118) 11:57:42.536343 run osmo-hlr_10.42.42.2(pid=4801): stderr: | 20221210115739488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115739489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115739489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115739489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115739489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115739489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115739501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115739510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115739511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115739511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:42.585964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4791): Terminating (SIGTERM) 11:57:42.625492 run iperf3-srv_10.42.42.10(pid=4792): Terminating (SIGTERM) 11:57:42.664745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4796): Terminating (SIGTERM) 11:57:42.703952 run iperf3-srv_10.42.42.10(pid=4797): Terminating (SIGTERM) 11:57:42.743033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Terminating (SIGTERM) 11:57:42.782340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Terminating (SIGTERM) 11:57:42.821461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4806): Terminating (SIGTERM) 11:57:42.861069 --- ParallelTerminationStrategy: PID 4791 died... 11:57:42.879733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4791): Terminated: ok {rc=0} 11:57:42.923327 --- ParallelTerminationStrategy: PID 4792 died... 11:57:42.941378 run iperf3-srv_10.42.42.10(pid=4792): Terminated {rc=256} 11:57:42.984876 --- ParallelTerminationStrategy: PID 4796 died... 11:57:43.003555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4796): Terminated: ok {rc=0} 11:57:43.047559 --- ParallelTerminationStrategy: PID 4797 died... 11:57:43.065775 run iperf3-srv_10.42.42.10(pid=4797): Terminated {rc=256} 11:57:43.109310 --- ParallelTerminationStrategy: PID 4800 died... 11:57:43.128004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Terminated: ok {rc=0} 11:57:43.172111 --- ParallelTerminationStrategy: PID 4803 died... 11:57:43.190338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Terminated: ok {rc=0} 11:57:43.233798 --- ParallelTerminationStrategy: PID 4806 died... 11:57:43.252080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4806): Terminated: ok {rc=0} 11:57:43.337108 bus /gobi_0: Setting Powered False 11:57:44.436257 bus /gobi_0: Setting Powered False 11:57:45.551617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:57:46.720276 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:46.733410 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:57:46.807544 tst iperf3.py: using LAC 28233 11:57:46.934007 tst iperf3.py: using RAC 183 11:57:47.057300 tst iperf3.py: using CellId 28233 11:57:47.205561 tst iperf3.py: using BVCI 28234 11:57:47.320373 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.331328 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.342071 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.353285 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.363991 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.374985 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.386007 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.396754 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:47.407763 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:57:47.525395 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:57:47.725308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:48.022798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4808): Launched 11:57:48.282258 run iperf3-srv_10.42.42.10(pid=4809): Launched 11:57:48.394244 tst iperf3.py:8: start network... 11:57:48.593582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:49.053280 run create_hlr_db(pid=4810): Launched 11:57:49.167026 bus /gobi_6: Setting Powered False 11:57:50.226455 run create_hlr_db(pid=4810): Terminated: ok {rc=0} 11:57:50.661879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4812): Launched 11:57:50.981892 run osmo-hlr_10.42.42.2(pid=4813): Launched 11:57:51.103125 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:51.657370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4815): Launched 11:57:51.990341 run osmo-stp_10.42.42.5(pid=4816): Launched 11:57:52.111230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:52.662744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4818): Launched 11:57:52.785204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:53.055156 run patchelf(pid=4819): Launched 11:57:53.233201 run osmo-stp_10.42.42.5(pid=4816): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4816)] 11:57:53.368214 run osmo-stp_10.42.42.5(pid=4816): stdout: | (launched: 2022-12-10_11:57:51.932038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:53.505361 run osmo-stp_10.42.42.5(pid=4816): stderr: | 20221210115752124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115752124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115752124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115752124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115752127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115752127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115752127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:53.642162 run osmo-stp_10.42.42.5(pid=4816): stdout: | (launched: 2022-12-10_11:57:51.932038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:53.773188 run osmo-stp_10.42.42.5(pid=4816): stderr: | 20221210115752124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115752124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115752124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115752124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115752127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115752127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115752127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:53.928615 run patchelf(pid=4819): Terminating (SIGINT) 11:57:54.108401 run patchelf(pid=4819): Terminated: ok {rc=0} 11:57:54.237462 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4816): Process ended prematurely: osmo-stp_10.42.42.5(pid=4816) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4816)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 11:57:54.247572 tst iperf3.py:8: Test FAILED (7.6 sec) 11:57:54.275884 run osmo-hlr_10.42.42.2(pid=4813): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4813)] 11:57:54.325596 run osmo-hlr_10.42.42.2(pid=4813): stdout: | (launched: 2022-12-10_11:57:50.923880) 11:57:54.377556 run osmo-hlr_10.42.42.2(pid=4813): stderr: | 20221210115751123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115751123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115751123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115751123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115751123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115751123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115751136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115751144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115751144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115751145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:54.429367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4808): Terminating (SIGTERM) 11:57:54.470803 run iperf3-srv_10.42.42.10(pid=4809): Terminating (SIGTERM) 11:57:54.512373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4812): Terminating (SIGTERM) 11:57:54.553595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4815): Terminating (SIGTERM) 11:57:54.595028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4818): Terminating (SIGTERM) 11:57:54.636699 --- ParallelTerminationStrategy: PID 4808 died... 11:57:54.656636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4808): Terminated: ok {rc=0} 11:57:54.702617 --- ParallelTerminationStrategy: PID 4809 died... 11:57:54.722023 run iperf3-srv_10.42.42.10(pid=4809): Terminated {rc=256} 11:57:54.767845 --- ParallelTerminationStrategy: PID 4812 died... 11:57:54.787237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4812): Terminated: ok {rc=0} 11:57:54.833089 --- ParallelTerminationStrategy: PID 4815 died... 11:57:54.852603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4815): Terminated: ok {rc=0} 11:57:54.898754 --- ParallelTerminationStrategy: PID 4818 died... 11:57:54.918337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4818): Terminated: ok {rc=0} 11:57:55.006516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:57:56.157364 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.169387 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:57:56.243493 tst iperf3m4.py: using LAC 28234 11:57:56.367903 tst iperf3m4.py: using RAC 184 11:57:56.490459 tst iperf3m4.py: using CellId 28234 11:57:56.614249 tst iperf3m4.py: using BVCI 28235 11:57:56.732102 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.743327 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.754471 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.765501 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.776561 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.787642 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.798832 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.809820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:57:56.821026 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:57:56.940216 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:57:57.057324 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:57:57.176257 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:57:57.294331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:57:57.509963 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:57.829578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4820): Launched 11:57:58.107927 run iperf3-srv_10.42.42.10(pid=4821): Launched 11:57:58.227640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:57:58.442340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:58.761909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4822): Launched 11:57:59.039855 run iperf3-srv_10.42.42.10(pid=4823): Launched 11:57:59.159616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:57:59.374032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:59.693590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4824): Launched 11:57:59.971546 run iperf3-srv_10.42.42.10(pid=4825): Launched 11:58:00.090960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:58:00.304751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:00.624085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4826): Launched 11:58:00.934962 run iperf3-srv_10.42.42.10(pid=4827): Launched 11:58:01.076625 tst iperf3m4.py:8: start network... 11:58:01.296251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:01.801777 run create_hlr_db(pid=4828): Launched 11:58:01.963249 bus /gobi_6: Setting Powered False 11:58:03.025891 run create_hlr_db(pid=4828): Terminated: ok {rc=0} 11:58:03.453819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4830): Launched 11:58:03.752355 run osmo-hlr_10.42.42.2(pid=4831): Launched 11:58:03.867108 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:04.381303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4833): Launched 11:58:04.680260 run osmo-stp_10.42.42.5(pid=4834): Launched 11:58:04.794523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:05.309278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4836): Launched 11:58:05.424142 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:05.677590 run patchelf(pid=4837): Launched 11:58:05.844119 run osmo-stp_10.42.42.5(pid=4834): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4834)] 11:58:05.971063 run osmo-stp_10.42.42.5(pid=4834): stdout: | (launched: 2022-12-10_11:58:04.625365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:06.099920 run osmo-stp_10.42.42.5(pid=4834): stderr: | 20221210115804796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115804796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115804796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115804797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115804799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115804799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115804799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:06.228477 run osmo-stp_10.42.42.5(pid=4834): stdout: | (launched: 2022-12-10_11:58:04.625365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:06.351460 run osmo-stp_10.42.42.5(pid=4834): stderr: | 20221210115804796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115804796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115804796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115804797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115804799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115804799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115804799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:06.497071 run patchelf(pid=4837): Terminating (SIGINT) 11:58:06.665257 run patchelf(pid=4837): Terminated: ok {rc=0} 11:58:06.786255 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4834): Process ended prematurely: osmo-stp_10.42.42.5(pid=4834) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4834)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:58:06.795711 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:58:06.823530 run osmo-hlr_10.42.42.2(pid=4831): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4831)] 11:58:06.871795 run osmo-hlr_10.42.42.2(pid=4831): stdout: | (launched: 2022-12-10_11:58:03.697479) 11:58:06.921487 run osmo-hlr_10.42.42.2(pid=4831): stderr: | 20221210115803873 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115803873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115803873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115803873 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115803873 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115803873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115803885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115803894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115803894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115803894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:06.971696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4820): Terminating (SIGTERM) 11:58:07.011681 run iperf3-srv_10.42.42.10(pid=4821): Terminating (SIGTERM) 11:58:07.051916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4822): Terminating (SIGTERM) 11:58:07.091874 run iperf3-srv_10.42.42.10(pid=4823): Terminating (SIGTERM) 11:58:07.132035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4824): Terminating (SIGTERM) 11:58:07.172153 run iperf3-srv_10.42.42.10(pid=4825): Terminating (SIGTERM) 11:58:07.212322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4826): Terminating (SIGTERM) 11:58:07.252484 run iperf3-srv_10.42.42.10(pid=4827): Terminating (SIGTERM) 11:58:07.292544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4830): Terminating (SIGTERM) 11:58:07.332673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4833): Terminating (SIGTERM) 11:58:07.372787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4836): Terminating (SIGTERM) 11:58:07.412874 --- ParallelTerminationStrategy: PID 4820 died... 11:58:07.431893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4820): Terminated: ok {rc=0} 11:58:07.476410 --- ParallelTerminationStrategy: PID 4821 died... 11:58:07.495163 run iperf3-srv_10.42.42.10(pid=4821): Terminated {rc=256} 11:58:07.539096 --- ParallelTerminationStrategy: PID 4822 died... 11:58:07.557591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4822): Terminated: ok {rc=0} 11:58:07.601681 --- ParallelTerminationStrategy: PID 4823 died... 11:58:07.620006 run iperf3-srv_10.42.42.10(pid=4823): Terminated {rc=256} 11:58:07.663842 --- ParallelTerminationStrategy: PID 4824 died... 11:58:07.682218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4824): Terminated: ok {rc=0} 11:58:07.726205 --- ParallelTerminationStrategy: PID 4825 died... 11:58:07.744728 run iperf3-srv_10.42.42.10(pid=4825): Terminated {rc=256} 11:58:07.788829 --- ParallelTerminationStrategy: PID 4826 died... 11:58:07.807723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4826): Terminated: ok {rc=0} 11:58:07.852092 --- ParallelTerminationStrategy: PID 4827 died... 11:58:07.870708 run iperf3-srv_10.42.42.10(pid=4827): Terminated {rc=256} 11:58:07.914889 --- ParallelTerminationStrategy: PID 4830 died... 11:58:07.933479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4830): Terminated: ok {rc=0} 11:58:07.977598 --- ParallelTerminationStrategy: PID 4833 died... 11:58:07.996247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4833): Terminated: ok {rc=0} 11:58:08.040360 --- ParallelTerminationStrategy: PID 4836 died... 11:58:08.058988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4836): Terminated: ok {rc=0} 11:58:08.145441 bus /gobi_4: Setting Powered False 11:58:09.243720 bus /gobi_4: Setting Powered False 11:58:10.359108 bus /gobi_1: Setting Powered False 11:58:11.457129 bus /gobi_1: Setting Powered False 11:58:12.571214 bus /gobi_0: Setting Powered False 11:58:13.669739 bus /gobi_0: Setting Powered False 11:58:14.785461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:58:15.903623 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:15.917020 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:58:15.994789 tst ping.py: using LAC 28235 11:58:16.126544 tst ping.py: using RAC 185 11:58:16.290438 tst ping.py: using CellId 28235 11:58:16.417091 tst ping.py: using BVCI 28236 11:58:16.534033 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:16.546441 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:16.559086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:16.571416 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:16.583175 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:16.595072 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:16.607358 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:16.619718 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:16.740297 tst ping.py:19: start network... 11:58:16.953786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:17.461860 run create_hlr_db(pid=4838): Launched 11:58:17.575470 bus /gobi_6: Setting Powered False 11:58:18.634999 run create_hlr_db(pid=4838): Terminated: ok {rc=0} 11:58:19.067529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4840): Launched 11:58:19.382439 run osmo-hlr_10.42.42.2(pid=4841): Launched 11:58:19.502855 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:20.044199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Launched 11:58:20.357710 run osmo-stp_10.42.42.5(pid=4844): Launched 11:58:20.478049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:21.021210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4846): Launched 11:58:21.141159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:21.406079 run patchelf(pid=4847): Launched 11:58:21.580173 run osmo-stp_10.42.42.5(pid=4844): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4844)] 11:58:21.713354 run osmo-stp_10.42.42.5(pid=4844): stdout: | (launched: 2022-12-10_11:58:20.300681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:21.847594 run osmo-stp_10.42.42.5(pid=4844): stderr: | 20221210115820490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115820490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115820490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115820490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115820493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115820493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115820493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:21.983072 run osmo-stp_10.42.42.5(pid=4844): stdout: | (launched: 2022-12-10_11:58:20.300681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:22.111815 run osmo-stp_10.42.42.5(pid=4844): stderr: | 20221210115820490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115820490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115820490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115820490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115820493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115820493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115820493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:22.264864 run patchelf(pid=4847): Terminating (SIGINT) 11:58:22.440356 run patchelf(pid=4847): Terminated: ok {rc=0} 11:58:22.566562 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4844): Process ended prematurely: osmo-stp_10.42.42.5(pid=4844) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4844)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 11:58:22.575971 tst ping.py:22: Test FAILED (6.7 sec) 11:58:22.603969 run osmo-hlr_10.42.42.2(pid=4841): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4841)] 11:58:22.653559 run osmo-hlr_10.42.42.2(pid=4841): stdout: | (launched: 2022-12-10_11:58:19.325173) 11:58:22.705151 run osmo-hlr_10.42.42.2(pid=4841): stderr: | 20221210115819522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115819522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115819522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115819522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115819522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115819522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115819535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115819545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115819545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115819546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:22.756774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4840): Terminating (SIGTERM) 11:58:22.798338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Terminating (SIGTERM) 11:58:22.839923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4846): Terminating (SIGTERM) 11:58:22.882473 --- ParallelTerminationStrategy: PID 4840 died... 11:58:22.902534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4840): Terminated: ok {rc=0} 11:58:22.949181 --- ParallelTerminationStrategy: PID 4843 died... 11:58:22.968865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Terminated: ok {rc=0} 11:58:23.014733 --- ParallelTerminationStrategy: PID 4846 died... 11:58:23.034367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4846): Terminated: ok {rc=0} 11:58:23.122346 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:58:24.211171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.223667 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:58:24.297294 tst ping_idle_ping.py: using LAC 28236 11:58:24.420754 tst ping_idle_ping.py: using RAC 186 11:58:24.547530 tst ping_idle_ping.py: using CellId 28236 11:58:24.670675 tst ping_idle_ping.py: using BVCI 28237 11:58:24.784891 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.796308 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.807445 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.818523 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.829549 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.840579 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.851857 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:24.862912 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:24.977207 tst ping_idle_ping.py:24: start network... 11:58:25.176088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:25.634408 run create_hlr_db(pid=4848): Launched 11:58:25.748548 bus /gobi_6: Setting Powered False 11:58:26.808294 run create_hlr_db(pid=4848): Terminated: ok {rc=0} 11:58:27.240025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4850): Launched 11:58:27.555405 run osmo-hlr_10.42.42.2(pid=4851): Launched 11:58:27.676142 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:28.216896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4853): Launched 11:58:28.532878 run osmo-stp_10.42.42.5(pid=4854): Launched 11:58:28.654172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:29.199313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4856): Launched 11:58:29.320126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:29.586860 run patchelf(pid=4857): Launched 11:58:29.761858 run osmo-stp_10.42.42.5(pid=4854): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4854)] 11:58:29.895589 run osmo-stp_10.42.42.5(pid=4854): stdout: | (launched: 2022-12-10_11:58:28.475427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:30.031613 run osmo-stp_10.42.42.5(pid=4854): stderr: | 20221210115828664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115828664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115828664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115828665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115828667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115828667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115828667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:30.167004 run osmo-stp_10.42.42.5(pid=4854): stdout: | (launched: 2022-12-10_11:58:28.475427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:30.296764 run osmo-stp_10.42.42.5(pid=4854): stderr: | 20221210115828664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115828664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115828664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115828665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115828667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115828667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115828667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:30.450751 run patchelf(pid=4857): Terminating (SIGINT) 11:58:30.627699 run patchelf(pid=4857): Terminated: ok {rc=0} 11:58:30.754733 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4854): Process ended prematurely: osmo-stp_10.42.42.5(pid=4854) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4854)] [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:58:30.764080 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:58:30.792228 run osmo-hlr_10.42.42.2(pid=4851): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4851)] 11:58:30.846195 run osmo-hlr_10.42.42.2(pid=4851): stdout: | (launched: 2022-12-10_11:58:27.498127) 11:58:30.916447 run osmo-hlr_10.42.42.2(pid=4851): stderr: | 20221210115827695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115827695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115827695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115827695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115827695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115827695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115827708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115827719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115827719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115827719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:30.970328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4850): Terminating (SIGTERM) 11:58:31.012864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4853): Terminating (SIGTERM) 11:58:31.055378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4856): Terminating (SIGTERM) 11:58:31.100033 --- ParallelTerminationStrategy: PID 4850 died... 11:58:31.120506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4850): Terminated: ok {rc=0} 11:58:31.169442 --- ParallelTerminationStrategy: PID 4853 died... 11:58:31.189569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4853): Terminated: ok {rc=0} 11:58:31.236467 --- ParallelTerminationStrategy: PID 4856 died... 11:58:31.256525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4856): Terminated: ok {rc=0} 11:58:31.345623 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:58:32.651160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:58:32.658046 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:58:32.690820 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:58:32.729724 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:58:32.822219 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:58:32.855610 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:58:32.894592 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:58:33.496100 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:58:33.547483 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:33.559097 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:58:33.610282 tst cs_paging_gprs_active.py: using LAC 28237 11:58:33.733366 tst cs_paging_gprs_active.py: using RAC 187 11:58:33.856898 tst cs_paging_gprs_active.py: using CellId 28237 11:58:33.983453 tst cs_paging_gprs_active.py: using BVCI 28238 11:58:34.100807 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.112373 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.123713 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.135124 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.146519 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.157855 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.169259 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.180497 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:34.192038 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:58:34.306587 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:58:34.422784 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:58:34.625517 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:34.926750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4861): Launched 11:58:35.189640 run iperf3-srv_10.42.42.10(pid=4862): Launched 11:58:35.303259 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:58:35.505980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:35.808133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4863): Launched 11:58:36.070240 run iperf3-srv_10.42.42.10(pid=4864): Launched 11:58:36.183532 tst cs_paging_gprs_active.py:38: start network... 11:58:36.385398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:36.850110 run create_hlr_db(pid=4865): Launched 11:58:36.965987 bus /gobi_6: Setting Powered False 11:58:38.026124 run create_hlr_db(pid=4865): Terminated: ok {rc=0} 11:58:38.465629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4867): Launched 11:58:38.787092 run osmo-hlr_10.42.42.2(pid=4868): Launched 11:58:38.909371 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:39.460017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4870): Launched 11:58:39.780029 run osmo-stp_10.42.42.5(pid=4871): Launched 11:58:39.901836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:40.455318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4873): Launched 11:58:40.578503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:40.848551 run patchelf(pid=4874): Launched 11:58:41.028159 run osmo-stp_10.42.42.5(pid=4871): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4871)] 11:58:41.164517 run osmo-stp_10.42.42.5(pid=4871): stdout: | (launched: 2022-12-10_11:58:39.721910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:41.302160 run osmo-stp_10.42.42.5(pid=4871): stderr: | 20221210115839913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115839913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115839913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115839914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115839916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115839916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115839916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:41.439651 run osmo-stp_10.42.42.5(pid=4871): stdout: | (launched: 2022-12-10_11:58:39.721910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:41.571250 run osmo-stp_10.42.42.5(pid=4871): stderr: | 20221210115839913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115839913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115839913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115839914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115839916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115839916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115839916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:41.727230 run patchelf(pid=4874): Terminating (SIGINT) 11:58:41.907386 run patchelf(pid=4874): Terminated: ok {rc=0} 11:58:42.038131 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4871): Process ended prematurely: osmo-stp_10.42.42.5(pid=4871) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4871)] [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:58:42.048505 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:58:42.077648 run osmo-hlr_10.42.42.2(pid=4868): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4868)] 11:58:42.128303 run osmo-hlr_10.42.42.2(pid=4868): stdout: | (launched: 2022-12-10_11:58:38.728814) 11:58:42.180375 run osmo-hlr_10.42.42.2(pid=4868): stderr: | 20221210115838926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115838926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115838926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115838926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115838926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115838926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115838939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115838949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115838950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115838950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:42.233256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4861): Terminating (SIGTERM) 11:58:42.275336 run iperf3-srv_10.42.42.10(pid=4862): Terminating (SIGTERM) 11:58:42.317726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4863): Terminating (SIGTERM) 11:58:42.360175 run iperf3-srv_10.42.42.10(pid=4864): Terminating (SIGTERM) 11:58:42.402417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4867): Terminating (SIGTERM) 11:58:42.444653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4870): Terminating (SIGTERM) 11:58:42.487011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4873): Terminating (SIGTERM) 11:58:42.529322 --- ParallelTerminationStrategy: PID 4861 died... 11:58:42.549315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4861): Terminated: ok {rc=0} 11:58:42.596173 --- ParallelTerminationStrategy: PID 4862 died... 11:58:42.615862 run iperf3-srv_10.42.42.10(pid=4862): Terminated {rc=256} 11:58:42.662266 --- ParallelTerminationStrategy: PID 4863 died... 11:58:42.681947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4863): Terminated: ok {rc=0} 11:58:42.728358 --- ParallelTerminationStrategy: PID 4864 died... 11:58:42.747854 run iperf3-srv_10.42.42.10(pid=4864): Terminated {rc=256} 11:58:42.794153 --- ParallelTerminationStrategy: PID 4867 died... 11:58:42.813909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4867): Terminated: ok {rc=0} 11:58:42.860371 --- ParallelTerminationStrategy: PID 4870 died... 11:58:42.879966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4870): Terminated: ok {rc=0} 11:58:42.926701 --- ParallelTerminationStrategy: PID 4873 died... 11:58:42.946308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4873): Terminated: ok {rc=0} 11:58:43.034194 bus /gobi_0: Setting Powered False 11:58:44.133394 bus /gobi_0: Setting Powered False 11:58:45.249978 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:58:46.425579 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:46.443754 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:58:46.514185 tst iperf3.py: using LAC 28238 11:58:46.643770 tst iperf3.py: using RAC 188 11:58:46.768056 tst iperf3.py: using CellId 28238 11:58:46.927241 tst iperf3.py: using BVCI 28239 11:58:47.068870 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.080873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.092714 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.104669 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.116851 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.129219 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.141786 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.153690 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:47.166080 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:58:47.284582 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:47.502323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:47.824155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4875): Launched 11:58:48.104058 run iperf3-srv_10.42.42.10(pid=4876): Launched 11:58:48.224647 tst iperf3.py:8: start network... 11:58:48.441816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:48.937932 run create_hlr_db(pid=4877): Launched 11:58:49.069596 bus /gobi_6: Setting Powered False 11:58:50.132579 run create_hlr_db(pid=4877): Terminated: ok {rc=0} 11:58:50.561669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4879): Launched 11:58:50.862175 run osmo-hlr_10.42.42.2(pid=4880): Launched 11:58:50.975862 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:51.508635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4883): Launched 11:58:51.831000 run osmo-stp_10.42.42.5(pid=4884): Launched 11:58:51.953156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:52.503896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4886): Launched 11:58:52.626968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:52.898114 run patchelf(pid=4887): Launched 11:58:53.076632 run osmo-stp_10.42.42.5(pid=4884): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4884)] 11:58:53.213276 run osmo-stp_10.42.42.5(pid=4884): stdout: | (launched: 2022-12-10_11:58:51.772605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:53.351173 run osmo-stp_10.42.42.5(pid=4884): stderr: | 20221210115851967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115851967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115851968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115851968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115851969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115851969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115851969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:53.488657 run osmo-stp_10.42.42.5(pid=4884): stdout: | (launched: 2022-12-10_11:58:51.772605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:53.620028 run osmo-stp_10.42.42.5(pid=4884): stderr: | 20221210115851967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115851967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115851968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115851968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115851969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115851969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115851969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:53.775959 run patchelf(pid=4887): Terminating (SIGINT) 11:58:53.956286 run patchelf(pid=4887): Terminated: ok {rc=0} 11:58:54.086074 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4884): Process ended prematurely: osmo-stp_10.42.42.5(pid=4884) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4884)] [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:58:54.096433 tst iperf3.py:8: Test FAILED (7.7 sec) 11:58:54.125733 run osmo-hlr_10.42.42.2(pid=4880): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4880)] 11:58:54.176228 run osmo-hlr_10.42.42.2(pid=4880): stdout: | (launched: 2022-12-10_11:58:50.807476) 11:58:54.228264 run osmo-hlr_10.42.42.2(pid=4880): stderr: | 20221210115850983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115850983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115850983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115850983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115850983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115850983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115850995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115851004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115851004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115851004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:54.280650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4875): Terminating (SIGTERM) 11:58:54.323254 run iperf3-srv_10.42.42.10(pid=4876): Terminating (SIGTERM) 11:58:54.365566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4879): Terminating (SIGTERM) 11:58:54.407904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4883): Terminating (SIGTERM) 11:58:54.450279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4886): Terminating (SIGTERM) 11:58:54.492822 --- ParallelTerminationStrategy: PID 4875 died... 11:58:54.512942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4875): Terminated: ok {rc=0} 11:58:54.559926 --- ParallelTerminationStrategy: PID 4876 died... 11:58:54.579488 run iperf3-srv_10.42.42.10(pid=4876): Terminated {rc=256} 11:58:54.625939 --- ParallelTerminationStrategy: PID 4879 died... 11:58:54.645522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4879): Terminated: ok {rc=0} 11:58:54.691948 --- ParallelTerminationStrategy: PID 4883 died... 11:58:54.711686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4883): Terminated: ok {rc=0} 11:58:54.758429 --- ParallelTerminationStrategy: PID 4886 died... 11:58:54.778124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4886): Terminated: ok {rc=0} 11:58:54.866815 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:58:56.018776 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.031410 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:58:56.084519 tst iperf3m4.py: using LAC 28239 11:58:56.212262 tst iperf3m4.py: using RAC 189 11:58:56.336724 tst iperf3m4.py: using CellId 28239 11:58:56.454841 tst iperf3m4.py: using BVCI 28240 11:58:56.565692 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.576921 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.588084 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.599540 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.610886 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.622130 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.633468 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.644507 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:58:56.655853 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:58:56.770411 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:58:56.891261 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:58:57.007723 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:58:57.124196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:57.326722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:57.627644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4888): Launched 11:58:57.888366 run iperf3-srv_10.42.42.10(pid=4889): Launched 11:58:58.001683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:58:58.203531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:58.503767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4890): Launched 11:58:58.763967 run iperf3-srv_10.42.42.10(pid=4891): Launched 11:58:58.877144 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:58:59.079063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:59.380719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4892): Launched 11:58:59.641433 run iperf3-srv_10.42.42.10(pid=4893): Launched 11:58:59.753874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:58:59.953689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:00.253385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4894): Launched 11:59:00.513493 run iperf3-srv_10.42.42.10(pid=4895): Launched 11:59:00.625437 tst iperf3m4.py:8: start network... 11:59:00.825543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:01.361668 run create_hlr_db(pid=4896): Launched 11:59:01.527006 bus /gobi_6: Setting Powered False 11:59:02.589455 run create_hlr_db(pid=4896): Terminated: ok {rc=0} 11:59:03.038146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4898): Launched 11:59:03.359552 run osmo-hlr_10.42.42.2(pid=4899): Launched 11:59:03.481917 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:04.038755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Launched 11:59:04.359085 run osmo-stp_10.42.42.5(pid=4902): Launched 11:59:04.481636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:05.033987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4904): Launched 11:59:05.156900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:05.428777 run patchelf(pid=4905): Launched 11:59:05.606618 run osmo-stp_10.42.42.5(pid=4902): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4902)] 11:59:05.741815 run osmo-stp_10.42.42.5(pid=4902): stdout: | (launched: 2022-12-10_11:59:04.300647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:05.878710 run osmo-stp_10.42.42.5(pid=4902): stderr: | 20221210115904493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115904493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115904494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115904494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115904494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115904494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115904495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:06.015940 run osmo-stp_10.42.42.5(pid=4902): stdout: | (launched: 2022-12-10_11:59:04.300647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:06.147419 run osmo-stp_10.42.42.5(pid=4902): stderr: | 20221210115904493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115904493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115904494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115904494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115904494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115904494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115904495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:06.302771 run patchelf(pid=4905): Terminating (SIGINT) 11:59:06.481758 run patchelf(pid=4905): Terminated: ok {rc=0} 11:59:06.611200 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4902): Process ended prematurely: osmo-stp_10.42.42.5(pid=4902) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4902)] [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:59:06.621481 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:59:06.650180 run osmo-hlr_10.42.42.2(pid=4899): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4899)] 11:59:06.700501 run osmo-hlr_10.42.42.2(pid=4899): stdout: | (launched: 2022-12-10_11:59:03.301359) 11:59:06.752125 run osmo-hlr_10.42.42.2(pid=4899): stderr: | 20221210115903501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115903501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115903501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115903501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115903501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115903501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115903516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115903524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115903524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115903524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:06.804272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4888): Terminating (SIGTERM) 11:59:06.845989 run iperf3-srv_10.42.42.10(pid=4889): Terminating (SIGTERM) 11:59:06.887705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4890): Terminating (SIGTERM) 11:59:06.929848 run iperf3-srv_10.42.42.10(pid=4891): Terminating (SIGTERM) 11:59:06.971533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4892): Terminating (SIGTERM) 11:59:07.013669 run iperf3-srv_10.42.42.10(pid=4893): Terminating (SIGTERM) 11:59:07.055288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4894): Terminating (SIGTERM) 11:59:07.097014 run iperf3-srv_10.42.42.10(pid=4895): Terminating (SIGTERM) 11:59:07.138318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4898): Terminating (SIGTERM) 11:59:07.179881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Terminating (SIGTERM) 11:59:07.221825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4904): Terminating (SIGTERM) 11:59:07.263876 --- ParallelTerminationStrategy: PID 4888 died... 11:59:07.283805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4888): Terminated: ok {rc=0} 11:59:07.330062 --- ParallelTerminationStrategy: PID 4889 died... 11:59:07.349549 run iperf3-srv_10.42.42.10(pid=4889): Terminated {rc=256} 11:59:07.395294 --- ParallelTerminationStrategy: PID 4890 died... 11:59:07.414691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4890): Terminated: ok {rc=0} 11:59:07.460659 --- ParallelTerminationStrategy: PID 4891 died... 11:59:07.480104 run iperf3-srv_10.42.42.10(pid=4891): Terminated {rc=256} 11:59:07.526217 --- ParallelTerminationStrategy: PID 4892 died... 11:59:07.545823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4892): Terminated: ok {rc=0} 11:59:07.591930 --- ParallelTerminationStrategy: PID 4893 died... 11:59:07.611386 run iperf3-srv_10.42.42.10(pid=4893): Terminated {rc=256} 11:59:07.657550 --- ParallelTerminationStrategy: PID 4894 died... 11:59:07.677165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4894): Terminated: ok {rc=0} 11:59:07.723026 --- ParallelTerminationStrategy: PID 4895 died... 11:59:07.742515 run iperf3-srv_10.42.42.10(pid=4895): Terminated {rc=256} 11:59:07.788497 --- ParallelTerminationStrategy: PID 4898 died... 11:59:07.807938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4898): Terminated: ok {rc=0} 11:59:07.854161 --- ParallelTerminationStrategy: PID 4901 died... 11:59:07.873624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Terminated: ok {rc=0} 11:59:07.919287 --- ParallelTerminationStrategy: PID 4904 died... 11:59:07.939124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4904): Terminated: ok {rc=0} 11:59:08.025737 bus /gobi_4: Setting Powered False 11:59:09.123790 bus /gobi_4: Setting Powered False 11:59:10.235657 bus /gobi_1: Setting Powered False 11:59:11.333888 bus /gobi_1: Setting Powered False 11:59:12.448638 bus /gobi_0: Setting Powered False 11:59:13.546411 bus /gobi_0: Setting Powered False 11:59:14.662021 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:59:15.764170 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:15.776409 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:59:15.830406 tst ping.py: using LAC 28240 11:59:15.964897 tst ping.py: using RAC 190 11:59:16.091511 tst ping.py: using CellId 28240 11:59:16.216118 tst ping.py: using BVCI 28241 11:59:16.364329 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:16.379813 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:16.395399 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:16.411153 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:16.427192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:16.443875 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:16.460385 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:16.475273 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:16.601096 tst ping.py:19: start network... 11:59:16.817597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:17.313994 run create_hlr_db(pid=4906): Launched 11:59:17.444285 bus /gobi_6: Setting Powered False 11:59:18.507036 run create_hlr_db(pid=4906): Terminated: ok {rc=0} 11:59:18.945548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4908): Launched 11:59:19.259488 run osmo-hlr_10.42.42.2(pid=4909): Launched 11:59:19.380227 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:19.926333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4911): Launched 11:59:20.241265 run osmo-stp_10.42.42.5(pid=4912): Launched 11:59:20.361092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:20.902297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4914): Launched 11:59:21.022920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:21.288459 run patchelf(pid=4915): Launched 11:59:21.464236 run osmo-stp_10.42.42.5(pid=4912): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4912)] 11:59:21.597783 run osmo-stp_10.42.42.5(pid=4912): stdout: | (launched: 2022-12-10_11:59:20.183966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:21.732619 run osmo-stp_10.42.42.5(pid=4912): stderr: | 20221210115920375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115920375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115920376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115920376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115920376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115920377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115920377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:21.867692 run osmo-stp_10.42.42.5(pid=4912): stdout: | (launched: 2022-12-10_11:59:20.183966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:21.998236 run osmo-stp_10.42.42.5(pid=4912): stderr: | 20221210115920375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115920375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115920376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115920376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115920376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115920377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115920377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:22.151553 run patchelf(pid=4915): Terminating (SIGINT) 11:59:22.327888 run patchelf(pid=4915): Terminated: ok {rc=0} 11:59:22.454286 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4912): Process ended prematurely: osmo-stp_10.42.42.5(pid=4912) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4912)] [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:59:22.463749 tst ping.py:22: Test FAILED (6.7 sec) 11:59:22.491693 run osmo-hlr_10.42.42.2(pid=4909): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4909)] 11:59:22.541369 run osmo-hlr_10.42.42.2(pid=4909): stdout: | (launched: 2022-12-10_11:59:19.202404) 11:59:22.593102 run osmo-hlr_10.42.42.2(pid=4909): stderr: | 20221210115919399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115919399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115919399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115919399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115919399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115919399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115919412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115919421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115919421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115919421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:22.644841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4908): Terminating (SIGTERM) 11:59:22.686502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4911): Terminating (SIGTERM) 11:59:22.728082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4914): Terminating (SIGTERM) 11:59:22.770002 --- ParallelTerminationStrategy: PID 4908 died... 11:59:22.789932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4908): Terminated: ok {rc=0} 11:59:22.836126 --- ParallelTerminationStrategy: PID 4911 died... 11:59:22.855655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4911): Terminated: ok {rc=0} 11:59:22.901422 --- ParallelTerminationStrategy: PID 4914 died... 11:59:22.920848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4914): Terminated: ok {rc=0} 11:59:23.007913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:59:24.094550 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.106989 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:59:24.163097 tst ping_idle_ping.py: using LAC 28241 11:59:24.280124 tst ping_idle_ping.py: using RAC 191 11:59:24.396606 tst ping_idle_ping.py: using CellId 28241 11:59:24.513244 tst ping_idle_ping.py: using BVCI 28242 11:59:24.620841 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.632169 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.643144 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.655066 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.666737 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.678502 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.690475 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:24.702255 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:24.817264 tst ping_idle_ping.py:24: start network... 11:59:25.017194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:25.477505 run create_hlr_db(pid=4916): Launched 11:59:25.589987 bus /gobi_6: Setting Powered False 11:59:26.649372 run create_hlr_db(pid=4916): Terminated: ok {rc=0} 11:59:27.081939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4918): Launched 11:59:27.397472 run osmo-hlr_10.42.42.2(pid=4919): Launched 11:59:27.518786 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:28.062666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4921): Launched 11:59:28.377029 run osmo-stp_10.42.42.5(pid=4922): Launched 11:59:28.497100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:29.041794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4924): Launched 11:59:29.161733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:29.428151 run patchelf(pid=4925): Launched 11:59:29.603123 run osmo-stp_10.42.42.5(pid=4922): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4922)] 11:59:29.736156 run osmo-stp_10.42.42.5(pid=4922): stdout: | (launched: 2022-12-10_11:59:28.319524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:29.870538 run osmo-stp_10.42.42.5(pid=4922): stderr: | 20221210115928509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115928509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115928509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115928510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115928510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115928510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115928510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:30.005563 run osmo-stp_10.42.42.5(pid=4922): stdout: | (launched: 2022-12-10_11:59:28.319524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:30.134305 run osmo-stp_10.42.42.5(pid=4922): stderr: | 20221210115928509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115928509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115928509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115928510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115928510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115928510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115928510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:30.287004 run patchelf(pid=4925): Terminating (SIGINT) 11:59:30.463129 run patchelf(pid=4925): Terminated: ok {rc=0} 11:59:30.589930 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4922): Process ended prematurely: osmo-stp_10.42.42.5(pid=4922) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4922)] [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:59:30.599337 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:59:30.627057 run osmo-hlr_10.42.42.2(pid=4919): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4919)] 11:59:30.676125 run osmo-hlr_10.42.42.2(pid=4919): stdout: | (launched: 2022-12-10_11:59:27.339536) 11:59:30.727005 run osmo-hlr_10.42.42.2(pid=4919): stderr: | 20221210115927536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115927536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115927536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115927536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115927536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115927536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115927547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115927556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115927556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115927556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:30.778410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4918): Terminating (SIGTERM) 11:59:30.819401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4921): Terminating (SIGTERM) 11:59:30.861729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4924): Terminating (SIGTERM) 11:59:30.908657 --- ParallelTerminationStrategy: PID 4918 died... 11:59:30.928041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4918): Terminated: ok {rc=0} 11:59:30.974323 --- ParallelTerminationStrategy: PID 4921 died... 11:59:30.993906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4921): Terminated: ok {rc=0} 11:59:31.039743 --- ParallelTerminationStrategy: PID 4924 died... 11:59:31.059273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4924): Terminated: ok {rc=0} 11:59:31.147534 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:59:32.457826 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:59:32.464793 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:59:32.497840 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:59:32.532758 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:59:32.587683 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:59:32.620918 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:59:32.656174 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:59:33.218934 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:59:33.224162 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.236934 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:59:33.307087 tst switch_tch_pdch.py: using LAC 28242 11:59:33.431551 tst switch_tch_pdch.py: using RAC 192 11:59:33.554164 tst switch_tch_pdch.py: using CellId 28242 11:59:33.678733 tst switch_tch_pdch.py: using BVCI 28243 11:59:33.793419 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.804857 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.816304 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.827720 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.839081 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.850377 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.861990 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:59:33.873280 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:59:33.992099 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:59:34.107466 tst switch_tch_pdch.py:51: start network... 11:59:34.305899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:34.761387 run create_hlr_db(pid=4930): Launched 11:59:34.874841 bus /gobi_6: Setting Powered False 11:59:35.933894 run create_hlr_db(pid=4930): Terminated: ok {rc=0} 11:59:36.365677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Launched 11:59:36.679916 run osmo-hlr_10.42.42.2(pid=4933): Launched 11:59:36.800437 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:37.346244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Launched 11:59:37.660258 run osmo-stp_10.42.42.5(pid=4936): Launched 11:59:37.780569 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:38.322574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4938): Launched 11:59:38.442137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:38.706863 run patchelf(pid=4939): Launched 11:59:38.881229 run osmo-stp_10.42.42.5(pid=4936): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] 11:59:39.014983 run osmo-stp_10.42.42.5(pid=4936): stdout: | (launched: 2022-12-10_11:59:37.603214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:39.149633 run osmo-stp_10.42.42.5(pid=4936): stderr: | 20221210115937794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115937794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115937795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115937795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115937798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115937798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115937798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:39.283851 run osmo-stp_10.42.42.5(pid=4936): stdout: | (launched: 2022-12-10_11:59:37.603214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:39.412841 run osmo-stp_10.42.42.5(pid=4936): stderr: | 20221210115937794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115937794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115937795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115937795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115937798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115937798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115937798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:39.566597 run patchelf(pid=4939): Terminating (SIGINT) 11:59:39.742133 run patchelf(pid=4939): Terminated: ok {rc=0} 11:59:39.868526 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4936): Process ended prematurely: osmo-stp_10.42.42.5(pid=4936) [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:59:39.877993 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:59:39.905550 run osmo-hlr_10.42.42.2(pid=4933): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4933)] 11:59:39.955637 run osmo-hlr_10.42.42.2(pid=4933): stdout: | (launched: 2022-12-10_11:59:36.622812) 11:59:40.007113 run osmo-hlr_10.42.42.2(pid=4933): stderr: | 20221210115936821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115936821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115936821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115936821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115936821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115936821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115936834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115936843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115936843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115936843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:40.058608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Terminating (SIGTERM) 11:59:40.099812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Terminating (SIGTERM) 11:59:40.141137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4938): Terminating (SIGTERM) 11:59:40.182710 --- ParallelTerminationStrategy: PID 4932 died... 11:59:40.202388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Terminated: ok {rc=0} 11:59:40.248567 --- ParallelTerminationStrategy: PID 4935 died... 11:59:40.267837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Terminated: ok {rc=0} 11:59:40.313381 --- ParallelTerminationStrategy: PID 4938 died... 11:59:40.332683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4938): Terminated: ok {rc=0} 11:59:40.419794 bus /gobi_0: Setting Powered False 11:59:41.518900 bus /gobi_0: Setting Powered False 11:59:42.635032 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:59:43.887390 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:59:43.892897 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:59:43.925777 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:59:43.959825 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:59:44.013075 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:59:44.044675 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:59:44.078544 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:59:44.632822 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:59:44.637908 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:44.648591 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:59:44.716531 tst switch_tch_pdch.py: using LAC 28243 11:59:44.831761 tst switch_tch_pdch.py: using RAC 193 11:59:44.947246 tst switch_tch_pdch.py: using CellId 28243 11:59:45.064243 tst switch_tch_pdch.py: using BVCI 28244 11:59:45.170907 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:45.181968 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:45.192499 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:45.203453 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:45.214487 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:45.225424 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:45.236296 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:59:45.246995 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:59:45.359603 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:59:45.475816 tst switch_tch_pdch.py:51: start network... 11:59:45.689052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:46.160808 run create_hlr_db(pid=4943): Launched 11:59:46.316790 bus /gobi_6: Setting Powered False 11:59:47.376444 run create_hlr_db(pid=4943): Terminated: ok {rc=0} 11:59:47.780823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4945): Launched 11:59:48.096279 run osmo-hlr_10.42.42.2(pid=4946): Launched 11:59:48.216509 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:48.734340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4948): Launched 11:59:49.049444 run osmo-stp_10.42.42.5(pid=4949): Launched 11:59:49.169695 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:49.684326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4951): Launched 11:59:49.804656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:50.069985 run patchelf(pid=4952): Launched 11:59:50.244190 run osmo-stp_10.42.42.5(pid=4949): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4949)] 11:59:50.377172 run osmo-stp_10.42.42.5(pid=4949): stdout: | (launched: 2022-12-10_11:59:48.991832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:50.511613 run osmo-stp_10.42.42.5(pid=4949): stderr: | 20221210115949183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115949183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115949183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115949184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115949186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115949186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115949186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:50.646406 run osmo-stp_10.42.42.5(pid=4949): stdout: | (launched: 2022-12-10_11:59:48.991832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:50.774935 run osmo-stp_10.42.42.5(pid=4949): stderr: | 20221210115949183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210115949183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210115949183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210115949184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210115949186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210115949186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210115949186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:50.927298 run patchelf(pid=4952): Terminating (SIGINT) 11:59:51.103131 run patchelf(pid=4952): Terminated: ok {rc=0} 11:59:51.229257 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4949): Process ended prematurely: osmo-stp_10.42.42.5(pid=4949) [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4949)] [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:59:51.238777 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:59:51.266411 run osmo-hlr_10.42.42.2(pid=4946): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4946)] 11:59:51.315979 run osmo-hlr_10.42.42.2(pid=4946): stdout: | (launched: 2022-12-10_11:59:48.038943) 11:59:51.367262 run osmo-hlr_10.42.42.2(pid=4946): stderr: | 20221210115948236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210115948236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210115948236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210115948236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210115948236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210115948236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210115948249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210115948259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210115948259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210115948259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:51.418975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4945): Terminating (SIGTERM) 11:59:51.460537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4948): Terminating (SIGTERM) 11:59:51.502301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4951): Terminating (SIGTERM) 11:59:51.544256 --- ParallelTerminationStrategy: PID 4945 died... 11:59:51.564410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4945): Terminated: ok {rc=0} 11:59:51.611105 --- ParallelTerminationStrategy: PID 4948 died... 11:59:51.630657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4948): Terminated: ok {rc=0} 11:59:51.677212 --- ParallelTerminationStrategy: PID 4951 died... 11:59:51.696907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4951): Terminated: ok {rc=0} 11:59:51.785395 bus /gobi_0: Setting Powered False 11:59:52.885305 bus /gobi_0: Setting Powered False 11:59:54.005218 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_sms:trx-lms --------------------------------------------------------------------- 11:59:55.248795 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:59:55.252610 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 11:59:55.285957 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 11:59:55.292565 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 11:59:55.344097 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 11:59:55.376436 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 11:59:55.383002 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 11:59:55.920533 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 11:59:55.925493 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 11:59:55.935888 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 11:59:55.981598 tst mo_mt_sms.py: using LAC 28244 11:59:56.097829 tst mo_mt_sms.py: using RAC 194 11:59:56.223502 tst mo_mt_sms.py: using CellId 28244 11:59:56.340283 tst mo_mt_sms.py: using BVCI 28245 11:59:56.446836 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 11:59:56.562674 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 11:59:56.674904 tst mo_mt_sms.py:9: start nitb and bts... 11:59:56.873579 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:59:57.472464 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4956): Launched 11:59:57.767057 run osmo-nitb_10.42.42.2(pid=4957): Launched 11:59:57.931033 run osmo-nitb_10.42.42.2(pid=4957): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4957)] 11:59:58.062788 run osmo-nitb_10.42.42.2(pid=4957): stdout: | (launched: 2022-12-10_11:59:57.712828) 11:59:58.195787 run osmo-nitb_10.42.42.2(pid=4957): stderr: | (launched: 2022-12-10_11:59:57.756724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:59:58.329158 run osmo-nitb_10.42.42.2(pid=4957): stdout: | (launched: 2022-12-10_11:59:57.712828) 11:59:58.456830 run osmo-nitb_10.42.42.2(pid=4957): stderr: | (launched: 2022-12-10_11:59:57.756724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4957): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4957) [trial-2374↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4957)] 11:59:58.879596 tst osmo-nitb_10.42.42.2(pid=4957): stdout: | (launched: 2022-12-10_11:59:57.712828) 11:59:58.998941 tst osmo-nitb_10.42.42.2(pid=4957): stderr: | (launched: 2022-12-10_11:59:57.756724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:59:59.138684 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4957): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4957) [trial-2374↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4957)] [trial-2374↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 11:59:59.147035 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 11:59:59.153611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4956): Terminating (SIGTERM) 11:59:59.362191 --- ParallelTerminationStrategy: PID 4956 died... 11:59:59.382742 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4956): Terminated: ok {rc=0} 11:59:59.467696 bus /sierra_3: Setting Powered False 12:00:00.566344 bus /sierra_3: Setting Powered False 12:00:01.704623 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:trx-lms --------------------------------------------------------------------- 12:00:02.935993 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:02.940103 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 12:00:02.978334 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:00:03.009177 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 12:00:03.062609 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 12:00:03.097695 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:00:03.126360 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 12:00:03.664810 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 12:00:03.669719 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:03.680125 tst sms:trx-lms: Using 1 x bts (candidates: 1) 12:00:03.728210 tst mo_mt_sms.py: using LAC 28245 12:00:03.843382 tst mo_mt_sms.py: using RAC 195 12:00:03.958263 tst mo_mt_sms.py: using CellId 28245 12:00:04.072484 tst mo_mt_sms.py: using BVCI 28246 12:00:04.178526 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:04.188819 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:04.199121 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:04.209579 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:04.220043 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:04.230437 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:00:04.347174 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:00:04.467249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:04.954542 run create_hlr_db(pid=5011): Launched 12:00:05.083216 bus /sierra_2: Setting Powered False 12:00:06.145528 run create_hlr_db(pid=5011): Terminated: ok {rc=0} 12:00:06.584179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5013): Launched 12:00:06.897921 run osmo-hlr_10.42.42.2(pid=5014): Launched 12:00:07.018107 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:07.558302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5016): Launched 12:00:07.872563 run osmo-stp_10.42.42.5(pid=5017): Launched 12:00:07.993127 run osmo-msc_10.42.42.6: Starting osmo-msc 12:00:08.563489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5020): Launched 12:00:08.877053 run osmo-msc_10.42.42.6(pid=5021): Launched 12:00:09.052553 run osmo-stp_10.42.42.5(pid=5017): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5017)] 12:00:09.184206 run osmo-stp_10.42.42.5(pid=5017): stdout: | (launched: 2022-12-10_12:00:07.815604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:09.316612 run osmo-stp_10.42.42.5(pid=5017): stderr: | 20221210120008008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120008008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120008008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120008009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120008009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120008009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120008009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:09.448224 run osmo-stp_10.42.42.5(pid=5017): stdout: | (launched: 2022-12-10_12:00:07.815604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:09.573743 run osmo-stp_10.42.42.5(pid=5017): stderr: | 20221210120008008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120008008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120008008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120008009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120008009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120008009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120008009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:09.723761 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5017): Process ended prematurely: osmo-stp_10.42.42.5(pid=5017) [trial-2374↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5017)] [trial-2374↪sms:trx-lms↪mo_mt_sms.py:16] 12:00:09.732878 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 12:00:09.760327 run osmo-hlr_10.42.42.2(pid=5014): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5014)] 12:00:09.810559 run osmo-hlr_10.42.42.2(pid=5014): stdout: | (launched: 2022-12-10_12:00:06.840682) 12:00:09.862241 run osmo-hlr_10.42.42.2(pid=5014): stderr: | 20221210120007038 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120007038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120007038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120007038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120007038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120007038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120007051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120007060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120007061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120007061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:09.933924 run osmo-msc_10.42.42.6(pid=5021): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5021)] 12:00:09.984153 run osmo-msc_10.42.42.6(pid=5021): stdout: | (launched: 2022-12-10_12:00:08.819824) 12:00:10.035510 run osmo-msc_10.42.42.6(pid=5021): stderr: | 20221210120009142 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120009142 DLGLOBAL DEBUG validating counter group 0x7fb5d6e58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120009142 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120009142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120009143 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120009143 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120009144 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120009145 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120009145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120009145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:00:10.087128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5013): Terminating (SIGTERM) 12:00:10.128561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5016): Terminating (SIGTERM) 12:00:10.170062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5020): Terminating (SIGTERM) 12:00:10.211794 --- ParallelTerminationStrategy: PID 5013 died... 12:00:10.231576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5013): Terminated: ok {rc=0} 12:00:10.277636 --- ParallelTerminationStrategy: PID 5016 died... 12:00:10.297102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5016): Terminated: ok {rc=0} 12:00:10.343325 --- ParallelTerminationStrategy: PID 5020 died... 12:00:10.363054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5020): Terminated: ok {rc=0} 12:00:10.450739 bus /sierra_3: Setting Powered False 12:00:11.549442 bus /sierra_3: Setting Powered False 12:00:12.687545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-lms --------------------------------------------------------------------- 12:00:13.936750 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:13.941287 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:00:13.980242 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 12:00:13.987995 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:00:14.023694 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:00:14.060545 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 12:00:14.067826 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:00:14.585066 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 12:00:14.590525 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 12:00:14.603480 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 12:00:14.656832 tst assert_extension.py: using LAC 28246 12:00:14.786236 tst assert_extension.py: using RAC 196 12:00:14.902234 tst assert_extension.py: using CellId 28246 12:00:15.015939 tst assert_extension.py: using BVCI 28247 12:00:15.122114 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 12:00:15.235725 tst assert_extension.py:10: start nitb and bts... 12:00:15.433421 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:00:16.065035 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5378): Launched 12:00:16.401184 run osmo-nitb_10.42.42.2(pid=5379): Launched 12:00:16.585080 run osmo-nitb_10.42.42.2(pid=5379): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5379)] 12:00:16.721641 run osmo-nitb_10.42.42.2(pid=5379): stdout: | (launched: 2022-12-10_12:00:16.339344) 12:00:16.859518 run osmo-nitb_10.42.42.2(pid=5379): stderr: | (launched: 2022-12-10_12:00:16.384237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:00:16.997416 run osmo-nitb_10.42.42.2(pid=5379): stdout: | (launched: 2022-12-10_12:00:16.339344) 12:00:17.129223 run osmo-nitb_10.42.42.2(pid=5379): stderr: | (launched: 2022-12-10_12:00:16.384237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5379): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5379) [trial-2374↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5379)] 12:00:17.531867 tst osmo-nitb_10.42.42.2(pid=5379): stdout: | (launched: 2022-12-10_12:00:16.339344) 12:00:17.651488 tst osmo-nitb_10.42.42.2(pid=5379): stderr: | (launched: 2022-12-10_12:00:16.384237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:00:17.792848 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5379): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5379) [trial-2374↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5379)] [trial-2374↪nitb_ussd:trx-lms↪assert_extension.py:12] 12:00:17.801670 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:00:17.808186 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5378): Terminating (SIGTERM) 12:00:18.017543 --- ParallelTerminationStrategy: PID 5378 died... 12:00:18.040556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5378): Terminated: ok {rc=0} 12:00:18.129747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:trx-lms --------------------------------------------------------------------- 12:00:19.303722 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:19.307679 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:00:19.340989 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:00:19.367540 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:00:19.403802 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:00:19.437291 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:00:19.464285 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:00:19.988068 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:trx-lms assert_extension.py ---------------------------------------------- 12:00:19.994067 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:20.004906 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 12:00:20.054785 tst assert_extension.py: using LAC 28247 12:00:20.173347 tst assert_extension.py: using RAC 197 12:00:20.289617 tst assert_extension.py: using CellId 28247 12:00:20.405003 tst assert_extension.py: using BVCI 28248 12:00:20.519831 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:20.530890 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:20.541852 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:20.553076 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:20.564070 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:00:20.574952 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 12:00:20.686171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:21.143809 run create_hlr_db(pid=5384): Launched 12:00:21.257433 bus /sierra_2: Setting Powered False 12:00:22.316545 run create_hlr_db(pid=5384): Terminated: ok {rc=0} 12:00:22.728782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5386): Launched 12:00:23.037329 run osmo-hlr_10.42.42.2(pid=5391): Launched 12:00:23.273322 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:23.877719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5503): Launched 12:00:24.199769 run osmo-stp_10.42.42.5(pid=5565): Launched 12:00:24.417874 run osmo-msc_10.42.42.6: Starting osmo-msc 12:00:25.121746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5567): Launched 12:00:25.455146 run osmo-msc_10.42.42.6(pid=5568): Launched 12:00:25.812249 run osmo-stp_10.42.42.5(pid=5565): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5565)] 12:00:26.087994 run osmo-stp_10.42.42.5(pid=5565): stdout: | (launched: 2022-12-10_12:00:24.135247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:26.269112 run osmo-stp_10.42.42.5(pid=5565): stderr: | 20221210120024442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120024442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120024442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120024443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120024443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120024443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120024443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:26.404320 run osmo-stp_10.42.42.5(pid=5565): stdout: | (launched: 2022-12-10_12:00:24.135247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:26.533800 run osmo-stp_10.42.42.5(pid=5565): stderr: | 20221210120024442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120024442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120024442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120024443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120024443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120024443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120024443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:26.687924 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5565): Process ended prematurely: osmo-stp_10.42.42.5(pid=5565) [trial-2374↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5565)] [trial-2374↪ussd:trx-lms↪assert_extension.py:17] 12:00:26.697854 tst assert_extension.py:17: Test FAILED (6.7 sec) 12:00:26.727705 run osmo-hlr_10.42.42.2(pid=5391): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5391)] 12:00:26.779336 run osmo-hlr_10.42.42.2(pid=5391): stdout: | (launched: 2022-12-10_12:00:22.972683) 12:00:26.832227 run osmo-hlr_10.42.42.2(pid=5391): stderr: | 20221210120023207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120023207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120023207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120023207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120023207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120023207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120023219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120023227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120023227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120023227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:26.906047 run osmo-msc_10.42.42.6(pid=5568): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5568)] 12:00:26.958370 run osmo-msc_10.42.42.6(pid=5568): stdout: | (launched: 2022-12-10_12:00:25.390952) 12:00:27.011903 run osmo-msc_10.42.42.6(pid=5568): stderr: | 20221210120025898 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120025898 DLGLOBAL DEBUG validating counter group 0x7f7d9bc0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120025898 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120025898 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120025898 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120025899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120025900 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120025901 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120025901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120025901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:00:27.067132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5386): Terminating (SIGTERM) 12:00:27.110887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5503): Terminating (SIGTERM) 12:00:27.156904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5567): Terminating (SIGTERM) 12:00:27.202142 --- ParallelTerminationStrategy: PID 5386 died... 12:00:27.222686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5386): Terminated: ok {rc=0} 12:00:27.270854 --- ParallelTerminationStrategy: PID 5503 died... 12:00:27.290914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5503): Terminated: ok {rc=0} 12:00:27.338724 --- ParallelTerminationStrategy: PID 5567 died... 12:00:27.359676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5567): Terminated: ok {rc=0} 12:00:27.451780 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:00:28.669500 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:28.677407 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:00:28.713618 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:00:28.741781 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:00:28.793823 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:00:28.828883 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:00:28.862118 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:00:29.406128 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:00:29.458696 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:29.470352 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:00:29.541053 tst mo_mt_call.py: using LAC 28248 12:00:29.666161 tst mo_mt_call.py: using RAC 198 12:00:29.785896 tst mo_mt_call.py: using CellId 28248 12:00:29.903417 tst mo_mt_call.py: using BVCI 28249 12:00:30.012175 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:30.023162 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:30.034080 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:30.045140 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:30.056098 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:30.067112 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:00:30.184636 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:00:30.305276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:30.800189 run create_hlr_db(pid=5574): Launched 12:00:30.959240 bus /sierra_2: Setting Powered False 12:00:32.034884 run create_hlr_db(pid=5574): Terminated: ok {rc=0} 12:00:32.503485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5576): Launched 12:00:32.801821 run osmo-hlr_10.42.42.2(pid=5577): Launched 12:00:32.915478 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:33.442434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5579): Launched 12:00:33.742082 run osmo-stp_10.42.42.5(pid=5580): Launched 12:00:33.856138 run osmo-msc_10.42.42.6: Starting osmo-msc 12:00:34.395096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5582): Launched 12:00:34.693645 run osmo-msc_10.42.42.6(pid=5583): Launched 12:00:34.862283 run osmo-stp_10.42.42.5(pid=5580): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5580)] 12:00:34.989528 run osmo-stp_10.42.42.5(pid=5580): stdout: | (launched: 2022-12-10_12:00:33.687504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:35.116422 run osmo-stp_10.42.42.5(pid=5580): stderr: | 20221210120033855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120033856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120033856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120033856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120033857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120033857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120033857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:35.240549 run osmo-stp_10.42.42.5(pid=5580): stdout: | (launched: 2022-12-10_12:00:33.687504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:35.359604 run osmo-stp_10.42.42.5(pid=5580): stderr: | 20221210120033855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120033856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120033856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120033856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120033857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120033857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120033857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:35.502364 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5580): Process ended prematurely: osmo-stp_10.42.42.5(pid=5580) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5580)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:00:35.511126 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:00:35.538175 run osmo-hlr_10.42.42.2(pid=5577): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5577)] 12:00:35.586226 run osmo-hlr_10.42.42.2(pid=5577): stdout: | (launched: 2022-12-10_12:00:32.747372) 12:00:35.635187 run osmo-hlr_10.42.42.2(pid=5577): stderr: | 20221210120032922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120032922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120032922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120032922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120032922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120032922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120032934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120032945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120032945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120032946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:35.703504 run osmo-msc_10.42.42.6(pid=5583): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5583)] 12:00:35.751493 run osmo-msc_10.42.42.6(pid=5583): stdout: | (launched: 2022-12-10_12:00:34.638760) 12:00:35.800580 run osmo-msc_10.42.42.6(pid=5583): stderr: | 20221210120034907 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120034908 DLGLOBAL DEBUG validating counter group 0x7fdc16ad7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120034908 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120034908 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120034908 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120034908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120034910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120034910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120034911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120034911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:00:35.850085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5576): Terminating (SIGTERM) 12:00:35.889475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5579): Terminating (SIGTERM) 12:00:35.929124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5582): Terminating (SIGTERM) 12:00:35.968816 --- ParallelTerminationStrategy: PID 5576 died... 12:00:35.987656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5576): Terminated: ok {rc=0} 12:00:36.031444 --- ParallelTerminationStrategy: PID 5579 died... 12:00:36.049810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5579): Terminated: ok {rc=0} 12:00:36.093368 --- ParallelTerminationStrategy: PID 5582 died... 12:00:36.112213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5582): Terminated: ok {rc=0} 12:00:36.196374 bus /sierra_3: Setting Powered False 12:00:37.295240 bus /sierra_3: Setting Powered False 12:00:38.411317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:00:39.560439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:39.572729 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:00:39.643736 tst mo_mt_call_osmux.py: using LAC 28249 12:00:39.769170 tst mo_mt_call_osmux.py: using RAC 199 12:00:39.895746 tst mo_mt_call_osmux.py: using CellId 28249 12:00:40.022422 tst mo_mt_call_osmux.py: using BVCI 28250 12:00:40.140256 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:40.151683 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:40.162863 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:40.174170 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:40.185544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:00:40.196693 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:00:40.316637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:00:40.438970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:40.933234 run create_hlr_db(pid=5585): Launched 12:00:41.063829 bus /sierra_2: Setting Powered False 12:00:42.128030 run create_hlr_db(pid=5585): Terminated: ok {rc=0} 12:00:42.573640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5587): Launched 12:00:42.893092 run osmo-hlr_10.42.42.2(pid=5588): Launched 12:00:43.015847 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:43.565640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5590): Launched 12:00:43.884795 run osmo-stp_10.42.42.5(pid=5591): Launched 12:00:44.007879 run osmo-msc_10.42.42.6: Starting osmo-msc 12:00:44.586297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5593): Launched 12:00:44.906964 run osmo-msc_10.42.42.6(pid=5594): Launched 12:00:45.086011 run osmo-stp_10.42.42.5(pid=5591): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5591)] 12:00:45.220310 run osmo-stp_10.42.42.5(pid=5591): stdout: | (launched: 2022-12-10_12:00:43.827035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:45.355265 run osmo-stp_10.42.42.5(pid=5591): stderr: | 20221210120044019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120044019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120044019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120044020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120044020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120044020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120044020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:45.489649 run osmo-stp_10.42.42.5(pid=5591): stdout: | (launched: 2022-12-10_12:00:43.827035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:45.617689 run osmo-stp_10.42.42.5(pid=5591): stderr: | 20221210120044019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120044019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120044019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120044020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120044020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120044020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120044020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:45.770836 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5591): Process ended prematurely: osmo-stp_10.42.42.5(pid=5591) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5591)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:00:45.780401 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:00:45.808561 run osmo-hlr_10.42.42.2(pid=5588): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5588)] 12:00:45.873299 run osmo-hlr_10.42.42.2(pid=5588): stdout: | (launched: 2022-12-10_12:00:42.835184) 12:00:45.930299 run osmo-hlr_10.42.42.2(pid=5588): stderr: | 20221210120043032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120043032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120043032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120043032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120043032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120043032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120043044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120043053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120043053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120043053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:46.001937 run osmo-msc_10.42.42.6(pid=5594): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5594)] 12:00:46.053286 run osmo-msc_10.42.42.6(pid=5594): stdout: | (launched: 2022-12-10_12:00:44.848478) 12:00:46.106164 run osmo-msc_10.42.42.6(pid=5594): stderr: | 20221210120045173 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120045173 DLGLOBAL DEBUG validating counter group 0x7f5123eeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120045173 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120045173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120045174 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120045174 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120045175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120045176 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120045176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120045176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:00:46.159920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5587): Terminating (SIGTERM) 12:00:46.202498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5590): Terminating (SIGTERM) 12:00:46.246417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5593): Terminating (SIGTERM) 12:00:46.291019 --- ParallelTerminationStrategy: PID 5587 died... 12:00:46.311191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5587): Terminated: ok {rc=0} 12:00:46.361261 --- ParallelTerminationStrategy: PID 5590 died... 12:00:46.380659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5590): Terminated: ok {rc=0} 12:00:46.428685 --- ParallelTerminationStrategy: PID 5593 died... 12:00:46.448198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5593): Terminated: ok {rc=0} 12:00:46.537753 bus /sierra_3: Setting Powered False 12:00:47.640567 bus /sierra_3: Setting Powered False 12:00:48.755327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:00:50.010221 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:50.017333 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:00:50.051874 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:00:50.079496 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:00:50.132610 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:00:50.165622 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:00:50.192188 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:00:50.744735 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:00:50.796311 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:00:50.807980 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:00:50.879613 tst mo_mt_call.py: using LAC 28250 12:00:51.010129 tst mo_mt_call.py: using RAC 200 12:00:51.149536 tst mo_mt_call.py: using CellId 28250 12:00:51.277021 tst mo_mt_call.py: using BVCI 28251 12:00:51.392667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:00:51.404058 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:00:51.415284 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:00:51.426657 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:00:51.438081 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:00:51.449436 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:00:51.563292 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:00:51.681482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:52.177600 run create_hlr_db(pid=5599): Launched 12:00:52.307640 bus /sierra_2: Setting Powered False 12:00:53.371766 run create_hlr_db(pid=5599): Terminated: ok {rc=0} 12:00:53.817717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5601): Launched 12:00:54.138846 run osmo-hlr_10.42.42.2(pid=5602): Launched 12:00:54.260514 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:54.808622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5604): Launched 12:00:55.128855 run osmo-stp_10.42.42.5(pid=5605): Launched 12:00:55.251324 run osmo-msc_10.42.42.6: Starting osmo-msc 12:00:55.830197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5607): Launched 12:00:56.151615 run osmo-msc_10.42.42.6(pid=5608): Launched 12:00:56.329943 run osmo-stp_10.42.42.5(pid=5605): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5605)] 12:00:56.464404 run osmo-stp_10.42.42.5(pid=5605): stdout: | (launched: 2022-12-10_12:00:55.070710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:56.599189 run osmo-stp_10.42.42.5(pid=5605): stderr: | 20221210120055264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120055264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120055265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120055265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120055265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120055266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120055266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:56.733414 run osmo-stp_10.42.42.5(pid=5605): stdout: | (launched: 2022-12-10_12:00:55.070710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:56.861396 run osmo-stp_10.42.42.5(pid=5605): stderr: | 20221210120055264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120055264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120055265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120055265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120055265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120055266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120055266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:57.015074 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5605): Process ended prematurely: osmo-stp_10.42.42.5(pid=5605) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5605)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:00:57.024773 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:00:57.053265 run osmo-hlr_10.42.42.2(pid=5602): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5602)] 12:00:57.103874 run osmo-hlr_10.42.42.2(pid=5602): stdout: | (launched: 2022-12-10_12:00:54.080565) 12:00:57.155710 run osmo-hlr_10.42.42.2(pid=5602): stderr: | 20221210120054277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120054277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120054277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120054277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120054277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120054277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120054294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120054303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120054303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120054304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:57.227699 run osmo-msc_10.42.42.6(pid=5608): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5608)] 12:00:57.277990 run osmo-msc_10.42.42.6(pid=5608): stdout: | (launched: 2022-12-10_12:00:56.093497) 12:00:57.330047 run osmo-msc_10.42.42.6(pid=5608): stderr: | 20221210120056417 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120056417 DLGLOBAL DEBUG validating counter group 0x7fd2da355c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120056417 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120056417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120056417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120056418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120056419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120056420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120056420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120056420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:00:57.382136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5601): Terminating (SIGTERM) 12:00:57.424074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5604): Terminating (SIGTERM) 12:00:57.466138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5607): Terminating (SIGTERM) 12:00:57.508272 --- ParallelTerminationStrategy: PID 5601 died... 12:00:57.527915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5601): Terminated: ok {rc=0} 12:00:57.574561 --- ParallelTerminationStrategy: PID 5604 died... 12:00:57.594185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5604): Terminated: ok {rc=0} 12:00:57.640715 --- ParallelTerminationStrategy: PID 5607 died... 12:00:57.660356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5607): Terminated: ok {rc=0} 12:00:57.749331 bus /sierra_3: Setting Powered False 12:00:58.845855 bus /sierra_3: Setting Powered False 12:00:59.962821 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:01:01.114634 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:01.127594 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:01:01.200004 tst mo_mt_call_osmux.py: using LAC 28251 12:01:01.369720 tst mo_mt_call_osmux.py: using RAC 201 12:01:01.514517 tst mo_mt_call_osmux.py: using CellId 28251 12:01:01.644644 tst mo_mt_call_osmux.py: using BVCI 28252 12:01:01.758898 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:01.771016 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:01.782862 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:01.797171 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:01.810220 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:01.822069 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:01:01.967461 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:01:02.094146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:02.577884 run create_hlr_db(pid=5610): Launched 12:01:02.693340 bus /sierra_2: Setting Powered False 12:01:03.753511 run create_hlr_db(pid=5610): Terminated: ok {rc=0} 12:01:04.171341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5612): Launched 12:01:04.471165 run osmo-hlr_10.42.42.2(pid=5613): Launched 12:01:04.585193 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:05.097383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5615): Launched 12:01:05.404685 run osmo-stp_10.42.42.5(pid=5616): Launched 12:01:05.529473 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:06.110986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5618): Launched 12:01:06.432077 run osmo-msc_10.42.42.6(pid=5619): Launched 12:01:06.610543 run osmo-stp_10.42.42.5(pid=5616): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5616)] 12:01:06.745478 run osmo-stp_10.42.42.5(pid=5616): stdout: | (launched: 2022-12-10_12:01:05.346388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:06.879632 run osmo-stp_10.42.42.5(pid=5616): stderr: | 20221210120105539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120105539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120105539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120105539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120105540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120105540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120105540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:07.014502 run osmo-stp_10.42.42.5(pid=5616): stdout: | (launched: 2022-12-10_12:01:05.346388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:07.142373 run osmo-stp_10.42.42.5(pid=5616): stderr: | 20221210120105539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120105539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120105539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120105539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120105540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120105540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120105540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:07.294952 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5616): Process ended prematurely: osmo-stp_10.42.42.5(pid=5616) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5616)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:01:07.304473 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:01:07.332588 run osmo-hlr_10.42.42.2(pid=5613): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5613)] 12:01:07.382162 run osmo-hlr_10.42.42.2(pid=5613): stdout: | (launched: 2022-12-10_12:01:04.416269) 12:01:07.433698 run osmo-hlr_10.42.42.2(pid=5613): stderr: | 20221210120104594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120104594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120104594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120104594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120104594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120104595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120104610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120104620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120104620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120104620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:07.505379 run osmo-msc_10.42.42.6(pid=5619): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5619)] 12:01:07.555225 run osmo-msc_10.42.42.6(pid=5619): stdout: | (launched: 2022-12-10_12:01:06.373734) 12:01:07.606529 run osmo-msc_10.42.42.6(pid=5619): stderr: | 20221210120106697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120106697 DLGLOBAL DEBUG validating counter group 0x7fcfa4dbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120106697 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120106697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120106697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120106698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120106699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120106700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120106700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120106700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:07.657883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5612): Terminating (SIGTERM) 12:01:07.699403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5615): Terminating (SIGTERM) 12:01:07.741036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5618): Terminating (SIGTERM) 12:01:07.783002 --- ParallelTerminationStrategy: PID 5612 died... 12:01:07.802881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5612): Terminated: ok {rc=0} 12:01:07.849299 --- ParallelTerminationStrategy: PID 5615 died... 12:01:07.868702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5615): Terminated: ok {rc=0} 12:01:07.914587 --- ParallelTerminationStrategy: PID 5618 died... 12:01:07.934082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5618): Terminated: ok {rc=0} 12:01:08.021324 bus /sierra_3: Setting Powered False 12:01:09.119185 bus /sierra_3: Setting Powered False 12:01:10.234680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:01:11.487060 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:11.494161 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:01:11.528364 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:01:11.555746 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:01:11.610686 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:01:11.643718 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:01:11.669901 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:01:12.221387 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:01:12.274371 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:12.286082 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:01:12.357561 tst mo_mt_call.py: using LAC 28252 12:01:12.487654 tst mo_mt_call.py: using RAC 202 12:01:12.613491 tst mo_mt_call.py: using CellId 28252 12:01:12.737432 tst mo_mt_call.py: using BVCI 28253 12:01:12.853578 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:12.865067 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:12.876266 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:12.887987 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:12.899810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:12.911387 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:01:13.028448 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:01:13.145613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:13.610312 run create_hlr_db(pid=5624): Launched 12:01:13.725027 bus /sierra_2: Setting Powered False 12:01:14.785358 run create_hlr_db(pid=5624): Terminated: ok {rc=0} 12:01:15.204447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5626): Launched 12:01:15.506161 run osmo-hlr_10.42.42.2(pid=5627): Launched 12:01:15.621505 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:16.161604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5629): Launched 12:01:16.475538 run osmo-stp_10.42.42.5(pid=5630): Launched 12:01:16.731454 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:17.350631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5632): Launched 12:01:17.664140 run osmo-msc_10.42.42.6(pid=5633): Launched 12:01:17.832372 run osmo-stp_10.42.42.5(pid=5630): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5630)] 12:01:17.959544 run osmo-stp_10.42.42.5(pid=5630): stdout: | (launched: 2022-12-10_12:01:16.413441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:18.086820 run osmo-stp_10.42.42.5(pid=5630): stderr: | 20221210120116669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120116669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120116669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120116670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120116670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120116670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120116670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:18.211614 run osmo-stp_10.42.42.5(pid=5630): stdout: | (launched: 2022-12-10_12:01:16.413441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:18.331542 run osmo-stp_10.42.42.5(pid=5630): stderr: | 20221210120116669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120116669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120116669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120116670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120116670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120116670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120116670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:18.474549 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5630): Process ended prematurely: osmo-stp_10.42.42.5(pid=5630) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5630)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:01:18.483258 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:01:18.509926 run osmo-hlr_10.42.42.2(pid=5627): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5627)] 12:01:18.557433 run osmo-hlr_10.42.42.2(pid=5627): stdout: | (launched: 2022-12-10_12:01:15.450823) 12:01:18.606736 run osmo-hlr_10.42.42.2(pid=5627): stderr: | 20221210120115630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120115630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120115630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120115630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120115630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120115630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120115643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120115653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120115654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120115654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:18.675208 run osmo-msc_10.42.42.6(pid=5633): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5633)] 12:01:18.722694 run osmo-msc_10.42.42.6(pid=5633): stdout: | (launched: 2022-12-10_12:01:17.609138) 12:01:18.771854 run osmo-msc_10.42.42.6(pid=5633): stderr: | 20221210120117881 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120117881 DLGLOBAL DEBUG validating counter group 0x7f3418b6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120117881 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120117881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120117881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120117882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120117883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120117884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120117884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120117884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:18.821568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5626): Terminating (SIGTERM) 12:01:18.861186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5629): Terminating (SIGTERM) 12:01:18.900931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5632): Terminating (SIGTERM) 12:01:18.940776 --- ParallelTerminationStrategy: PID 5626 died... 12:01:18.959679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5626): Terminated: ok {rc=0} 12:01:19.003486 --- ParallelTerminationStrategy: PID 5629 died... 12:01:19.021833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5629): Terminated: ok {rc=0} 12:01:19.065588 --- ParallelTerminationStrategy: PID 5632 died... 12:01:19.083973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5632): Terminated: ok {rc=0} 12:01:19.167769 bus /sierra_3: Setting Powered False 12:01:20.265825 bus /sierra_3: Setting Powered False 12:01:21.384067 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:01:22.533627 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:22.545853 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:01:22.617215 tst mo_mt_call_osmux.py: using LAC 28253 12:01:22.743200 tst mo_mt_call_osmux.py: using RAC 203 12:01:22.868621 tst mo_mt_call_osmux.py: using CellId 28253 12:01:22.996010 tst mo_mt_call_osmux.py: using BVCI 28254 12:01:23.114159 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:23.125812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:23.137055 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:23.148459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:23.159954 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:01:23.171298 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:01:23.287565 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:01:23.403396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:23.868835 run create_hlr_db(pid=5635): Launched 12:01:23.984560 bus /sierra_2: Setting Powered False 12:01:25.044927 run create_hlr_db(pid=5635): Terminated: ok {rc=0} 12:01:25.483095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5637): Launched 12:01:25.804073 run osmo-hlr_10.42.42.2(pid=5638): Launched 12:01:25.926558 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:26.481269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5640): Launched 12:01:26.801199 run osmo-stp_10.42.42.5(pid=5641): Launched 12:01:26.923337 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:27.502489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5643): Launched 12:01:27.822365 run osmo-msc_10.42.42.6(pid=5644): Launched 12:01:28.001031 run osmo-stp_10.42.42.5(pid=5641): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5641)] 12:01:28.135689 run osmo-stp_10.42.42.5(pid=5641): stdout: | (launched: 2022-12-10_12:01:26.742882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:28.271072 run osmo-stp_10.42.42.5(pid=5641): stderr: | 20221210120126937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120126937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120126937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120126938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120126938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120126938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120126938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:28.405789 run osmo-stp_10.42.42.5(pid=5641): stdout: | (launched: 2022-12-10_12:01:26.742882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:28.533534 run osmo-stp_10.42.42.5(pid=5641): stderr: | 20221210120126937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120126937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120126937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120126938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120126938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120126938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120126938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:28.686000 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5641): Process ended prematurely: osmo-stp_10.42.42.5(pid=5641) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5641)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:01:28.695310 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:01:28.722943 run osmo-hlr_10.42.42.2(pid=5638): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5638)] 12:01:28.772312 run osmo-hlr_10.42.42.2(pid=5638): stdout: | (launched: 2022-12-10_12:01:25.745863) 12:01:28.823402 run osmo-hlr_10.42.42.2(pid=5638): stderr: | 20221210120125946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120125946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120125946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120125946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120125946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120125946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120125959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120125969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120125969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120125969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:28.894652 run osmo-msc_10.42.42.6(pid=5644): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5644)] 12:01:28.944182 run osmo-msc_10.42.42.6(pid=5644): stdout: | (launched: 2022-12-10_12:01:27.764246) 12:01:28.995500 run osmo-msc_10.42.42.6(pid=5644): stderr: | 20221210120128086 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120128086 DLGLOBAL DEBUG validating counter group 0x7ff53a6e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120128086 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120128086 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120128087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120128087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120128088 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120128089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120128089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120128089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:29.047222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5637): Terminating (SIGTERM) 12:01:29.088400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5640): Terminating (SIGTERM) 12:01:29.129694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5643): Terminating (SIGTERM) 12:01:29.171216 --- ParallelTerminationStrategy: PID 5637 died... 12:01:29.190933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5637): Terminated: ok {rc=0} 12:01:29.236606 --- ParallelTerminationStrategy: PID 5640 died... 12:01:29.255994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5640): Terminated: ok {rc=0} 12:01:29.302313 --- ParallelTerminationStrategy: PID 5643 died... 12:01:29.321720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5643): Terminated: ok {rc=0} 12:01:29.408884 bus /sierra_3: Setting Powered False 12:01:30.507660 bus /sierra_3: Setting Powered False 12:01:31.622434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:01:32.868765 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:32.875320 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:01:32.908854 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:01:32.935486 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:01:32.987658 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:01:33.021696 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:01:33.048332 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:01:33.594839 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:01:33.644512 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:33.655625 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:01:33.727103 tst mo_mt_call.py: using LAC 28254 12:01:33.844189 tst mo_mt_call.py: using RAC 204 12:01:33.959505 tst mo_mt_call.py: using CellId 28254 12:01:34.075192 tst mo_mt_call.py: using BVCI 28255 12:01:34.193283 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:34.204730 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:34.215998 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:34.227449 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:34.238983 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:34.250506 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:01:34.364022 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:01:34.479898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:34.942652 run create_hlr_db(pid=5650): Launched 12:01:35.059013 bus /sierra_2: Setting Powered False 12:01:36.118451 run create_hlr_db(pid=5650): Terminated: ok {rc=0} 12:01:36.556516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5652): Launched 12:01:36.875308 run osmo-hlr_10.42.42.2(pid=5653): Launched 12:01:36.997552 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:37.545577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5655): Launched 12:01:37.864170 run osmo-stp_10.42.42.5(pid=5656): Launched 12:01:37.986601 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:38.563989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5658): Launched 12:01:38.883835 run osmo-msc_10.42.42.6(pid=5659): Launched 12:01:39.062593 run osmo-stp_10.42.42.5(pid=5656): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5656)] 12:01:39.200739 run osmo-stp_10.42.42.5(pid=5656): stdout: | (launched: 2022-12-10_12:01:37.806180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:39.335204 run osmo-stp_10.42.42.5(pid=5656): stderr: | 20221210120138000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120138000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120138000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120138001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120138001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120138001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120138002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:39.469777 run osmo-stp_10.42.42.5(pid=5656): stdout: | (launched: 2022-12-10_12:01:37.806180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:39.597110 run osmo-stp_10.42.42.5(pid=5656): stderr: | 20221210120138000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120138000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120138000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120138001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120138001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120138001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120138002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:39.749454 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5656): Process ended prematurely: osmo-stp_10.42.42.5(pid=5656) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5656)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:01:39.759095 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:01:39.786941 run osmo-hlr_10.42.42.2(pid=5653): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5653)] 12:01:39.836777 run osmo-hlr_10.42.42.2(pid=5653): stdout: | (launched: 2022-12-10_12:01:36.817562) 12:01:39.888582 run osmo-hlr_10.42.42.2(pid=5653): stderr: | 20221210120137015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120137015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120137015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120137015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120137015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120137015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120137028 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120137036 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120137037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120137037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:39.960079 run osmo-msc_10.42.42.6(pid=5659): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5659)] 12:01:40.010351 run osmo-msc_10.42.42.6(pid=5659): stdout: | (launched: 2022-12-10_12:01:38.825792) 12:01:40.061590 run osmo-msc_10.42.42.6(pid=5659): stderr: | 20221210120139150 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120139150 DLGLOBAL DEBUG validating counter group 0x7ff88bb77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120139150 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120139150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120139150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120139150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120139152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120139152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120139153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120139153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:40.113379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5652): Terminating (SIGTERM) 12:01:40.154390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5655): Terminating (SIGTERM) 12:01:40.195992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5658): Terminating (SIGTERM) 12:01:40.237932 --- ParallelTerminationStrategy: PID 5652 died... 12:01:40.257326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5652): Terminated: ok {rc=0} 12:01:40.303533 --- ParallelTerminationStrategy: PID 5655 died... 12:01:40.323114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5655): Terminated: ok {rc=0} 12:01:40.369261 --- ParallelTerminationStrategy: PID 5658 died... 12:01:40.388852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5658): Terminated: ok {rc=0} 12:01:40.476770 bus /sierra_3: Setting Powered False 12:01:41.575884 bus /sierra_3: Setting Powered False 12:01:42.691927 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:01:43.833916 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:43.845715 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:01:43.914099 tst mo_mt_call_osmux.py: using LAC 28255 12:01:44.031704 tst mo_mt_call_osmux.py: using RAC 205 12:01:44.150537 tst mo_mt_call_osmux.py: using CellId 28255 12:01:44.268382 tst mo_mt_call_osmux.py: using BVCI 28256 12:01:44.376420 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:44.387510 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:44.398431 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:44.409434 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:44.420367 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:01:44.431301 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:01:44.549380 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:01:44.662841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:45.128908 run create_hlr_db(pid=5661): Launched 12:01:45.243602 bus /sierra_2: Setting Powered False 12:01:46.305933 run create_hlr_db(pid=5661): Terminated: ok {rc=0} 12:01:46.740868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5663): Launched 12:01:47.072443 run osmo-hlr_10.42.42.2(pid=5664): Launched 12:01:47.274525 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:47.828034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5666): Launched 12:01:48.149313 run osmo-stp_10.42.42.5(pid=5667): Launched 12:01:48.271073 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:48.850586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5669): Launched 12:01:49.171995 run osmo-msc_10.42.42.6(pid=5670): Launched 12:01:49.351349 run osmo-stp_10.42.42.5(pid=5667): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5667)] 12:01:49.486132 run osmo-stp_10.42.42.5(pid=5667): stdout: | (launched: 2022-12-10_12:01:48.091140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:49.621684 run osmo-stp_10.42.42.5(pid=5667): stderr: | 20221210120148284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120148284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120148285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120148285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120148286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120148286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120148286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:49.756551 run osmo-stp_10.42.42.5(pid=5667): stdout: | (launched: 2022-12-10_12:01:48.091140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:49.885435 run osmo-stp_10.42.42.5(pid=5667): stderr: | 20221210120148284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120148284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120148285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120148285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120148286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120148286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120148286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:50.039657 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5667): Process ended prematurely: osmo-stp_10.42.42.5(pid=5667) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5667)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:01:50.049750 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:01:50.078078 run osmo-hlr_10.42.42.2(pid=5664): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5664)] 12:01:50.128777 run osmo-hlr_10.42.42.2(pid=5664): stdout: | (launched: 2022-12-10_12:01:47.005829) 12:01:50.180748 run osmo-hlr_10.42.42.2(pid=5664): stderr: | 20221210120147232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120147232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120147232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120147232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120147232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120147232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120147251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120147261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120147261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120147261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:50.253114 run osmo-msc_10.42.42.6(pid=5670): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5670)] 12:01:50.303606 run osmo-msc_10.42.42.6(pid=5670): stdout: | (launched: 2022-12-10_12:01:49.113730) 12:01:50.355512 run osmo-msc_10.42.42.6(pid=5670): stderr: | 20221210120149435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120149435 DLGLOBAL DEBUG validating counter group 0x7f0ea4020c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120149435 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120149435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120149435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120149436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120149437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120149438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120149438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120149438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:50.407507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5663): Terminating (SIGTERM) 12:01:50.449241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5666): Terminating (SIGTERM) 12:01:50.490969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5669): Terminating (SIGTERM) 12:01:50.533667 --- ParallelTerminationStrategy: PID 5663 died... 12:01:50.553764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5663): Terminated: ok {rc=0} 12:01:50.600506 --- ParallelTerminationStrategy: PID 5666 died... 12:01:50.620092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5666): Terminated: ok {rc=0} 12:01:50.666558 --- ParallelTerminationStrategy: PID 5669 died... 12:01:50.686292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5669): Terminated: ok {rc=0} 12:01:50.773638 bus /sierra_3: Setting Powered False 12:01:51.874775 bus /sierra_3: Setting Powered False 12:01:52.991401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:01:54.249178 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:54.256096 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:01:54.291137 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:01:54.318731 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:01:54.370595 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:01:54.404484 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:01:54.431496 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:01:54.982959 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:01:55.035545 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:01:55.047065 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:01:55.117794 tst mo_mt_call.py: using LAC 28256 12:01:55.245153 tst mo_mt_call.py: using RAC 206 12:01:55.362810 tst mo_mt_call.py: using CellId 28256 12:01:55.480357 tst mo_mt_call.py: using BVCI 28257 12:01:55.590285 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:01:55.601426 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:01:55.612339 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:01:55.623611 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:01:55.634992 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:01:55.646527 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:01:55.764257 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:01:55.882780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:56.378026 run create_hlr_db(pid=5675): Launched 12:01:56.508118 bus /sierra_2: Setting Powered False 12:01:57.568346 run create_hlr_db(pid=5675): Terminated: ok {rc=0} 12:01:57.995728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5677): Launched 12:01:58.295812 run osmo-hlr_10.42.42.2(pid=5678): Launched 12:01:58.410268 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:58.937170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5680): Launched 12:01:59.237126 run osmo-stp_10.42.42.5(pid=5681): Launched 12:01:59.352402 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:59.894079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5683): Launched 12:02:00.194635 run osmo-msc_10.42.42.6(pid=5684): Launched 12:02:00.363329 run osmo-stp_10.42.42.5(pid=5681): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5681)] 12:02:00.494724 run osmo-stp_10.42.42.5(pid=5681): stdout: | (launched: 2022-12-10_12:01:59.182594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:00.622675 run osmo-stp_10.42.42.5(pid=5681): stderr: | 20221210120159353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120159353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120159353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120159354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120159354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120159354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120159354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:00.747588 run osmo-stp_10.42.42.5(pid=5681): stdout: | (launched: 2022-12-10_12:01:59.182594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:00.879565 run osmo-stp_10.42.42.5(pid=5681): stderr: | 20221210120159353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120159353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120159353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120159354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120159354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120159354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120159354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:01.049618 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5681): Process ended prematurely: osmo-stp_10.42.42.5(pid=5681) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5681)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:02:01.060253 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:02:01.089452 run osmo-hlr_10.42.42.2(pid=5678): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5678)] 12:02:01.142881 run osmo-hlr_10.42.42.2(pid=5678): stdout: | (launched: 2022-12-10_12:01:58.241212) 12:02:01.196189 run osmo-hlr_10.42.42.2(pid=5678): stderr: | 20221210120158419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120158419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120158419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120158419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120158419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120158419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120158440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120158449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120158449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120158449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:01.269956 run osmo-msc_10.42.42.6(pid=5684): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5684)] 12:02:01.322226 run osmo-msc_10.42.42.6(pid=5684): stdout: | (launched: 2022-12-10_12:02:00.139431) 12:02:01.376774 run osmo-msc_10.42.42.6(pid=5684): stderr: | 20221210120200414 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120200414 DLGLOBAL DEBUG validating counter group 0x7f00055bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120200414 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120200414 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120200414 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120200415 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120200416 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120200417 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120200417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120200417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:01.428362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5677): Terminating (SIGTERM) 12:02:01.470041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5680): Terminating (SIGTERM) 12:02:01.512418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5683): Terminating (SIGTERM) 12:02:01.554239 --- ParallelTerminationStrategy: PID 5677 died... 12:02:01.573427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5677): Terminated: ok {rc=0} 12:02:01.620006 --- ParallelTerminationStrategy: PID 5680 died... 12:02:01.639080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5680): Terminated: ok {rc=0} 12:02:01.686320 --- ParallelTerminationStrategy: PID 5683 died... 12:02:01.705672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5683): Terminated: ok {rc=0} 12:02:01.793085 bus /sierra_3: Setting Powered False 12:02:02.889316 bus /sierra_3: Setting Powered False 12:02:04.003023 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:02:05.148701 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:05.160603 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:02:05.229919 tst mo_mt_call_osmux.py: using LAC 28257 12:02:05.346896 tst mo_mt_call_osmux.py: using RAC 207 12:02:05.467552 tst mo_mt_call_osmux.py: using CellId 28257 12:02:05.585382 tst mo_mt_call_osmux.py: using BVCI 28258 12:02:05.693807 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:05.704905 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:05.715916 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:05.727318 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:05.738751 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:05.750233 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:02:05.864525 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:02:05.985173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:06.450775 run create_hlr_db(pid=5686): Launched 12:02:06.565478 bus /sierra_2: Setting Powered False 12:02:07.624927 run create_hlr_db(pid=5686): Terminated: ok {rc=0} 12:02:08.063761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5688): Launched 12:02:08.386173 run osmo-hlr_10.42.42.2(pid=5689): Launched 12:02:08.508429 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:09.059456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Launched 12:02:09.381853 run osmo-stp_10.42.42.5(pid=5692): Launched 12:02:09.505425 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:10.085834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5694): Launched 12:02:10.406068 run osmo-msc_10.42.42.6(pid=5695): Launched 12:02:10.584905 run osmo-stp_10.42.42.5(pid=5692): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] 12:02:10.721746 run osmo-stp_10.42.42.5(pid=5692): stdout: | (launched: 2022-12-10_12:02:09.321583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:10.856296 run osmo-stp_10.42.42.5(pid=5692): stderr: | 20221210120209512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120209512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120209512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120209513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120209516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120209516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120209517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:10.990015 run osmo-stp_10.42.42.5(pid=5692): stdout: | (launched: 2022-12-10_12:02:09.321583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:11.118255 run osmo-stp_10.42.42.5(pid=5692): stderr: | 20221210120209512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120209512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120209512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120209513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120209516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120209516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120209517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:11.270286 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5692): Process ended prematurely: osmo-stp_10.42.42.5(pid=5692) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:02:11.279729 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:02:11.307520 run osmo-hlr_10.42.42.2(pid=5689): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5689)] 12:02:11.356939 run osmo-hlr_10.42.42.2(pid=5689): stdout: | (launched: 2022-12-10_12:02:08.327894) 12:02:11.408147 run osmo-hlr_10.42.42.2(pid=5689): stderr: | 20221210120208524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120208524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120208524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120208524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120208524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120208524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120208537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120208545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120208545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120208545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:11.479537 run osmo-msc_10.42.42.6(pid=5695): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5695)] 12:02:11.528910 run osmo-msc_10.42.42.6(pid=5695): stdout: | (launched: 2022-12-10_12:02:10.348111) 12:02:11.580098 run osmo-msc_10.42.42.6(pid=5695): stderr: | 20221210120210671 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120210671 DLGLOBAL DEBUG validating counter group 0x7f578971ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120210671 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120210671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120210671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120210672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120210673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120210674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120210674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120210674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:11.631503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5688): Terminating (SIGTERM) 12:02:11.672425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Terminating (SIGTERM) 12:02:11.713622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5694): Terminating (SIGTERM) 12:02:11.755048 --- ParallelTerminationStrategy: PID 5688 died... 12:02:11.774818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5688): Terminated: ok {rc=0} 12:02:11.820544 --- ParallelTerminationStrategy: PID 5691 died... 12:02:11.839993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Terminated: ok {rc=0} 12:02:11.885964 --- ParallelTerminationStrategy: PID 5694 died... 12:02:11.905279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5694): Terminated: ok {rc=0} 12:02:11.991889 bus /sierra_3: Setting Powered False 12:02:13.090498 bus /sierra_3: Setting Powered False 12:02:14.205022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:02:15.452297 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:15.458848 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:02:15.492620 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:02:15.518892 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:02:15.572059 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:02:15.605943 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:02:15.632526 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:02:16.182937 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:02:16.254196 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:16.269556 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:02:16.353332 tst mo_mt_call.py: using LAC 28258 12:02:16.514373 tst mo_mt_call.py: using RAC 208 12:02:16.668924 tst mo_mt_call.py: using CellId 28258 12:02:16.824224 tst mo_mt_call.py: using BVCI 28259 12:02:16.963901 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:16.976028 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:16.987881 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:17.002093 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:17.015279 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:17.027115 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:02:17.150092 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:02:17.274303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:17.740668 run create_hlr_db(pid=5700): Launched 12:02:17.856606 bus /sierra_2: Setting Powered False 12:02:18.916850 run create_hlr_db(pid=5700): Terminated: ok {rc=0} 12:02:19.336275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5702): Launched 12:02:19.637715 run osmo-hlr_10.42.42.2(pid=5703): Launched 12:02:19.753206 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:20.280641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5705): Launched 12:02:20.581574 run osmo-stp_10.42.42.5(pid=5706): Launched 12:02:20.696004 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:21.238330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5708): Launched 12:02:21.539516 run osmo-msc_10.42.42.6(pid=5709): Launched 12:02:21.707710 run osmo-stp_10.42.42.5(pid=5706): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5706)] 12:02:21.835627 run osmo-stp_10.42.42.5(pid=5706): stdout: | (launched: 2022-12-10_12:02:20.526337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:21.963461 run osmo-stp_10.42.42.5(pid=5706): stderr: | 20221210120220697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120220697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120220697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120220697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120220698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120220698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120220698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:22.088621 run osmo-stp_10.42.42.5(pid=5706): stdout: | (launched: 2022-12-10_12:02:20.526337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:22.208102 run osmo-stp_10.42.42.5(pid=5706): stderr: | 20221210120220697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120220697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120220697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120220697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120220698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120220698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120220698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:22.351106 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5706): Process ended prematurely: osmo-stp_10.42.42.5(pid=5706) [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5706)] [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:02:22.360223 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:02:22.387590 run osmo-hlr_10.42.42.2(pid=5703): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5703)] 12:02:22.436060 run osmo-hlr_10.42.42.2(pid=5703): stdout: | (launched: 2022-12-10_12:02:19.582965) 12:02:22.485666 run osmo-hlr_10.42.42.2(pid=5703): stderr: | 20221210120219761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120219761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120219761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120219761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120219761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120219761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120219774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120219782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120219783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120219783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:22.555013 run osmo-msc_10.42.42.6(pid=5709): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5709)] 12:02:22.602634 run osmo-msc_10.42.42.6(pid=5709): stdout: | (launched: 2022-12-10_12:02:21.483981) 12:02:22.652094 run osmo-msc_10.42.42.6(pid=5709): stderr: | 20221210120221757 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120221758 DLGLOBAL DEBUG validating counter group 0x7f701ea86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120221758 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120221758 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120221758 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120221758 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120221760 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120221760 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120221760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120221760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:22.701706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5702): Terminating (SIGTERM) 12:02:22.741151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5705): Terminating (SIGTERM) 12:02:22.781352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5708): Terminating (SIGTERM) 12:02:22.821798 --- ParallelTerminationStrategy: PID 5702 died... 12:02:22.840759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5702): Terminated: ok {rc=0} 12:02:22.885080 --- ParallelTerminationStrategy: PID 5705 died... 12:02:22.903472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5705): Terminated: ok {rc=0} 12:02:22.947743 --- ParallelTerminationStrategy: PID 5708 died... 12:02:22.966213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5708): Terminated: ok {rc=0} 12:02:23.051776 bus /sierra_3: Setting Powered False 12:02:24.151472 bus /sierra_3: Setting Powered False 12:02:25.267090 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:02:26.410010 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:26.421860 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:02:26.492603 tst mo_mt_call_osmux.py: using LAC 28259 12:02:26.611618 tst mo_mt_call_osmux.py: using RAC 209 12:02:26.731174 tst mo_mt_call_osmux.py: using CellId 28259 12:02:26.851193 tst mo_mt_call_osmux.py: using BVCI 28260 12:02:26.961637 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:26.972838 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:26.983945 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:26.995405 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:27.007062 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:02:27.018221 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:02:27.133288 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:02:27.248241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:27.746770 run create_hlr_db(pid=5711): Launched 12:02:27.877601 bus /sierra_2: Setting Powered False 12:02:28.938271 run create_hlr_db(pid=5711): Terminated: ok {rc=0} 12:02:29.386478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5713): Launched 12:02:29.708724 run osmo-hlr_10.42.42.2(pid=5714): Launched 12:02:29.831240 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:30.386630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5716): Launched 12:02:30.706037 run osmo-stp_10.42.42.5(pid=5717): Launched 12:02:30.827470 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:31.568772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5719): Launched 12:02:31.927832 run osmo-msc_10.42.42.6(pid=5720): Launched 12:02:32.292571 run osmo-stp_10.42.42.5(pid=5717): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5717)] 12:02:32.422641 run osmo-stp_10.42.42.5(pid=5717): stdout: | (launched: 2022-12-10_12:02:30.647773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:32.548075 run osmo-stp_10.42.42.5(pid=5717): stderr: | 20221210120230840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120230840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120230840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120230840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120230841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120230841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120230841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:32.674214 run osmo-stp_10.42.42.5(pid=5717): stdout: | (launched: 2022-12-10_12:02:30.647773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:32.794899 run osmo-stp_10.42.42.5(pid=5717): stderr: | 20221210120230840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120230840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120230840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120230840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120230841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120230841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120230841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:32.939842 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5717): Process ended prematurely: osmo-stp_10.42.42.5(pid=5717) [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5717)] [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:02:32.949009 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:02:32.976675 run osmo-hlr_10.42.42.2(pid=5714): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5714)] 12:02:33.025378 run osmo-hlr_10.42.42.2(pid=5714): stdout: | (launched: 2022-12-10_12:02:29.650233) 12:02:33.075396 run osmo-hlr_10.42.42.2(pid=5714): stderr: | 20221210120229850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120229850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120229850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120229850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120229850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120229850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120229862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120229871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120229871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120229871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:33.145330 run osmo-msc_10.42.42.6(pid=5720): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5720)] 12:02:33.193953 run osmo-msc_10.42.42.6(pid=5720): stdout: | (launched: 2022-12-10_12:02:31.864872) 12:02:33.243607 run osmo-msc_10.42.42.6(pid=5720): stderr: | 20221210120232263 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120232263 DLGLOBAL DEBUG validating counter group 0x7faff4d66c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120232263 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120232263 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120232263 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120232263 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120232265 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120232265 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120232266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120232266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:33.293942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5713): Terminating (SIGTERM) 12:02:33.333945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5716): Terminating (SIGTERM) 12:02:33.374006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5719): Terminating (SIGTERM) 12:02:33.414401 --- ParallelTerminationStrategy: PID 5713 died... 12:02:33.433462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5713): Terminated: ok {rc=0} 12:02:33.478051 --- ParallelTerminationStrategy: PID 5716 died... 12:02:33.496649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5716): Terminated: ok {rc=0} 12:02:33.541426 --- ParallelTerminationStrategy: PID 5719 died... 12:02:33.560127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5719): Terminated: ok {rc=0} 12:02:33.646675 bus /sierra_3: Setting Powered False 12:02:34.745922 bus /sierra_3: Setting Powered False 12:02:35.859745 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:02:37.107358 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:37.113844 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:02:37.148275 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:02:37.175244 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:02:37.230522 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:02:37.264252 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:02:37.291081 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:02:37.834573 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:02:37.883984 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:37.894931 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:02:37.963951 tst mo_mt_call.py: using LAC 28260 12:02:38.084514 tst mo_mt_call.py: using RAC 210 12:02:38.202265 tst mo_mt_call.py: using CellId 28260 12:02:38.320453 tst mo_mt_call.py: using BVCI 28261 12:02:38.438044 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:38.449416 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:38.460632 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:38.471861 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:38.483354 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:38.494594 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:02:38.610744 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:02:38.728081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:39.225570 run create_hlr_db(pid=5728): Launched 12:02:39.356461 bus /sierra_2: Setting Powered False 12:02:40.420255 run create_hlr_db(pid=5728): Terminated: ok {rc=0} 12:02:40.850319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5730): Launched 12:02:41.152725 run osmo-hlr_10.42.42.2(pid=5731): Launched 12:02:41.267527 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:41.797464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5733): Launched 12:02:42.097896 run osmo-stp_10.42.42.5(pid=5734): Launched 12:02:42.211526 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:42.752012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5736): Launched 12:02:43.053675 run osmo-msc_10.42.42.6(pid=5737): Launched 12:02:43.222181 run osmo-stp_10.42.42.5(pid=5734): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5734)] 12:02:43.350354 run osmo-stp_10.42.42.5(pid=5734): stdout: | (launched: 2022-12-10_12:02:42.043194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:43.478071 run osmo-stp_10.42.42.5(pid=5734): stderr: | 20221210120242213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120242213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120242214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120242214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120242215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120242215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120242215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:43.604209 run osmo-stp_10.42.42.5(pid=5734): stdout: | (launched: 2022-12-10_12:02:42.043194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:43.724440 run osmo-stp_10.42.42.5(pid=5734): stderr: | 20221210120242213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120242213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120242214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120242214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120242215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120242215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120242215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:43.868041 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5734): Process ended prematurely: osmo-stp_10.42.42.5(pid=5734) [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5734)] [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:02:43.877109 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:02:43.903631 run osmo-hlr_10.42.42.2(pid=5731): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5731)] 12:02:43.951618 run osmo-hlr_10.42.42.2(pid=5731): stdout: | (launched: 2022-12-10_12:02:41.097316) 12:02:44.000687 run osmo-hlr_10.42.42.2(pid=5731): stderr: | 20221210120241272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120241272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120241272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120241272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120241272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120241272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120241284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120241293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120241294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120241294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:44.069622 run osmo-msc_10.42.42.6(pid=5737): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5737)] 12:02:44.117149 run osmo-msc_10.42.42.6(pid=5737): stdout: | (launched: 2022-12-10_12:02:42.998285) 12:02:44.166139 run osmo-msc_10.42.42.6(pid=5737): stderr: | 20221210120243271 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120243271 DLGLOBAL DEBUG validating counter group 0x7f1880678c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120243271 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120243271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120243271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120243272 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120243274 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120243274 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120243274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120243275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:44.215574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5730): Terminating (SIGTERM) 12:02:44.254871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5733): Terminating (SIGTERM) 12:02:44.294336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5736): Terminating (SIGTERM) 12:02:44.334396 --- ParallelTerminationStrategy: PID 5730 died... 12:02:44.353390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5730): Terminated: ok {rc=0} 12:02:44.397676 --- ParallelTerminationStrategy: PID 5733 died... 12:02:44.415864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5733): Terminated: ok {rc=0} 12:02:44.459983 --- ParallelTerminationStrategy: PID 5736 died... 12:02:44.478601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5736): Terminated: ok {rc=0} 12:02:44.564470 bus /sierra_3: Setting Powered False 12:02:45.662312 bus /sierra_3: Setting Powered False 12:02:46.771413 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:02:47.913770 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:47.924923 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:02:47.994037 tst mo_mt_call_osmux.py: using LAC 28261 12:02:48.114998 tst mo_mt_call_osmux.py: using RAC 211 12:02:48.233207 tst mo_mt_call_osmux.py: using CellId 28261 12:02:48.350337 tst mo_mt_call_osmux.py: using BVCI 28262 12:02:48.461246 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:48.471896 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:48.482484 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:48.493347 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:48.504037 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:02:48.514930 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:02:48.631227 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:02:48.746488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:49.246248 run create_hlr_db(pid=5739): Launched 12:02:49.377463 bus /sierra_2: Setting Powered False 12:02:50.441521 run create_hlr_db(pid=5739): Terminated: ok {rc=0} 12:02:50.872128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5741): Launched 12:02:51.173085 run osmo-hlr_10.42.42.2(pid=5742): Launched 12:02:51.287110 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:51.813396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5744): Launched 12:02:52.114402 run osmo-stp_10.42.42.5(pid=5745): Launched 12:02:52.228254 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:52.771092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5747): Launched 12:02:53.071444 run osmo-msc_10.42.42.6(pid=5748): Launched 12:02:53.241060 run osmo-stp_10.42.42.5(pid=5745): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5745)] 12:02:53.368696 run osmo-stp_10.42.42.5(pid=5745): stdout: | (launched: 2022-12-10_12:02:52.059800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:53.495934 run osmo-stp_10.42.42.5(pid=5745): stderr: | 20221210120252230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120252230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120252230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120252231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120252233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120252233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120252233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:53.620636 run osmo-stp_10.42.42.5(pid=5745): stdout: | (launched: 2022-12-10_12:02:52.059800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:53.740052 run osmo-stp_10.42.42.5(pid=5745): stderr: | 20221210120252230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120252230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120252230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120252231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120252233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120252233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120252233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:53.883704 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5745): Process ended prematurely: osmo-stp_10.42.42.5(pid=5745) [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5745)] [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:02:53.892480 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:02:53.919603 run osmo-hlr_10.42.42.2(pid=5742): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5742)] 12:02:53.967851 run osmo-hlr_10.42.42.2(pid=5742): stdout: | (launched: 2022-12-10_12:02:51.118279) 12:02:54.017311 run osmo-hlr_10.42.42.2(pid=5742): stderr: | 20221210120251294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120251294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120251294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120251294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120251294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120251294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120251307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120251318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120251318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120251318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:54.086012 run osmo-msc_10.42.42.6(pid=5748): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5748)] 12:02:54.133619 run osmo-msc_10.42.42.6(pid=5748): stdout: | (launched: 2022-12-10_12:02:53.016422) 12:02:54.182736 run osmo-msc_10.42.42.6(pid=5748): stderr: | 20221210120253292 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120253293 DLGLOBAL DEBUG validating counter group 0x7f1d8d094c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120253293 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120253293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120253294 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120253294 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120253295 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120253296 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120253296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120253296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:54.232395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5741): Terminating (SIGTERM) 12:02:54.272047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5744): Terminating (SIGTERM) 12:02:54.311741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5747): Terminating (SIGTERM) 12:02:54.351931 --- ParallelTerminationStrategy: PID 5741 died... 12:02:54.370839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5741): Terminated: ok {rc=0} 12:02:54.414924 --- ParallelTerminationStrategy: PID 5744 died... 12:02:54.433512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5744): Terminated: ok {rc=0} 12:02:54.477740 --- ParallelTerminationStrategy: PID 5747 died... 12:02:54.496278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5747): Terminated: ok {rc=0} 12:02:54.583375 bus /sierra_3: Setting Powered False 12:02:55.683200 bus /sierra_3: Setting Powered False 12:02:56.799410 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:trx-lms --------------------------------------------------------------------- 12:02:58.052536 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:58.057385 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 12:02:58.091321 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:02:58.118340 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 12:02:58.206253 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 12:02:58.240179 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:02:58.266630 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 12:02:58.849471 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 12:02:58.854770 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:02:58.865783 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:02:58.918663 tst emergency_mo_mt_call.py: using LAC 28262 12:02:59.037938 tst emergency_mo_mt_call.py: using RAC 212 12:02:59.153912 tst emergency_mo_mt_call.py: using CellId 28262 12:02:59.269947 tst emergency_mo_mt_call.py: using BVCI 28263 12:02:59.379066 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:02:59.389859 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:02:59.400326 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:02:59.411087 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:02:59.421884 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:02:59.432588 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:02:59.550072 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:02:59.666674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:00.123332 run create_hlr_db(pid=5753): Launched 12:03:00.235314 bus /sierra_2: Setting Powered False 12:03:01.293600 run create_hlr_db(pid=5753): Terminated: ok {rc=0} 12:03:01.718201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5756): Launched 12:03:02.048731 run osmo-hlr_10.42.42.2(pid=5757): Launched 12:03:02.223341 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:02.810517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5759): Launched 12:03:03.126570 run osmo-stp_10.42.42.5(pid=5760): Launched 12:03:03.254927 tst emergency_mo_mt_call.py: using MSISDN 7722 12:03:03.416720 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:03.984352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5762): Launched 12:03:04.300246 run osmo-msc_10.42.42.6(pid=5763): Launched 12:03:04.477400 run osmo-stp_10.42.42.5(pid=5760): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5760)] 12:03:04.610136 run osmo-stp_10.42.42.5(pid=5760): stdout: | (launched: 2022-12-10_12:03:03.068325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:04.743498 run osmo-stp_10.42.42.5(pid=5760): stderr: | 20221210120303259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120303259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120303260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120303260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120303261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120303261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120303261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:04.875894 run osmo-stp_10.42.42.5(pid=5760): stdout: | (launched: 2022-12-10_12:03:03.068325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:05.001969 run osmo-stp_10.42.42.5(pid=5760): stderr: | 20221210120303259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120303259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120303260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120303260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120303261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120303261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120303261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:05.153643 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5760): Process ended prematurely: osmo-stp_10.42.42.5(pid=5760) [trial-2374↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5760)] [trial-2374↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 12:03:05.162561 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 12:03:05.189805 run osmo-hlr_10.42.42.2(pid=5757): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5757)] 12:03:05.239878 run osmo-hlr_10.42.42.2(pid=5757): stdout: | (launched: 2022-12-10_12:03:01.987594) 12:03:05.291496 run osmo-hlr_10.42.42.2(pid=5757): stderr: | 20221210120302282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120302283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120302283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120302283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120302283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120302283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120302297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120302306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120302306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120302306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:05.363525 run osmo-msc_10.42.42.6(pid=5763): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5763)] 12:03:05.413156 run osmo-msc_10.42.42.6(pid=5763): stdout: | (launched: 2022-12-10_12:03:04.242849) 12:03:05.464150 run osmo-msc_10.42.42.6(pid=5763): stderr: | 20221210120304564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120304564 DLGLOBAL DEBUG validating counter group 0x7f9d6970dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120304565 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120304565 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120304565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120304565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120304567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120304567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120304567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120304567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:05.515638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5756): Terminating (SIGTERM) 12:03:05.556640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5759): Terminating (SIGTERM) 12:03:05.598042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5762): Terminating (SIGTERM) 12:03:05.639821 --- ParallelTerminationStrategy: PID 5756 died... 12:03:05.659760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5756): Terminated: ok {rc=0} 12:03:05.706513 --- ParallelTerminationStrategy: PID 5759 died... 12:03:05.726109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5759): Terminated: ok {rc=0} 12:03:05.771953 --- ParallelTerminationStrategy: PID 5762 died... 12:03:05.791473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5762): Terminated: ok {rc=0} 12:03:05.879264 bus /sierra_3: Setting Powered False 12:03:06.977754 bus /sierra_3: Setting Powered False 12:03:08.093988 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 12:03:09.181782 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:09.193451 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:03:09.245426 tst emergency_preemptive_call.py: using LAC 28263 12:03:09.370336 tst emergency_preemptive_call.py: using RAC 213 12:03:09.495756 tst emergency_preemptive_call.py: using CellId 28263 12:03:09.624556 tst emergency_preemptive_call.py: using BVCI 28264 12:03:09.740377 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:09.751445 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:09.762302 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:09.773168 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:09.784016 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:09.794794 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:03:09.911762 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:03:10.025248 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:03:10.141610 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:03:10.256454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:10.747481 run create_hlr_db(pid=5765): Launched 12:03:10.875071 bus /sierra_2: Setting Powered False 12:03:11.937945 run create_hlr_db(pid=5765): Terminated: ok {rc=0} 12:03:12.381047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5767): Launched 12:03:12.696578 run osmo-hlr_10.42.42.2(pid=5768): Launched 12:03:12.817072 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:13.365612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5770): Launched 12:03:13.680128 run osmo-stp_10.42.42.5(pid=5771): Launched 12:03:13.810693 tst emergency_preemptive_call.py: using MSISDN 7723 12:03:13.973510 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:14.540391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5773): Launched 12:03:14.856505 run osmo-msc_10.42.42.6(pid=5774): Launched 12:03:15.032600 run osmo-stp_10.42.42.5(pid=5771): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5771)] 12:03:15.170916 run osmo-stp_10.42.42.5(pid=5771): stdout: | (launched: 2022-12-10_12:03:13.622861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:15.305927 run osmo-stp_10.42.42.5(pid=5771): stderr: | 20221210120313815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120313815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120313816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120313816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120313817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120313817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120313817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:15.438430 run osmo-stp_10.42.42.5(pid=5771): stdout: | (launched: 2022-12-10_12:03:13.622861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:15.564699 run osmo-stp_10.42.42.5(pid=5771): stderr: | 20221210120313815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120313815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120313816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120313816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120313817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120313817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120313817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:15.715448 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5771): Process ended prematurely: osmo-stp_10.42.42.5(pid=5771) [trial-2374↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5771)] [trial-2374↪emergency:trx-lms↪emergency_preemptive_call.py:32] 12:03:15.724359 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 12:03:15.751998 run osmo-hlr_10.42.42.2(pid=5768): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5768)] 12:03:15.802252 run osmo-hlr_10.42.42.2(pid=5768): stdout: | (launched: 2022-12-10_12:03:12.639209) 12:03:15.853888 run osmo-hlr_10.42.42.2(pid=5768): stderr: | 20221210120312836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120312836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120312836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120312837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120312837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120312837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120312850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120312858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120312858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120312858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:15.939676 run osmo-msc_10.42.42.6(pid=5774): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5774)] 12:03:15.990226 run osmo-msc_10.42.42.6(pid=5774): stdout: | (launched: 2022-12-10_12:03:14.798950) 12:03:16.042122 run osmo-msc_10.42.42.6(pid=5774): stderr: | 20221210120315121 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120315121 DLGLOBAL DEBUG validating counter group 0x7f3c1c437c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120315121 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120315122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120315122 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120315122 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120315124 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120315124 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120315124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120315124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:16.094827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5767): Terminating (SIGTERM) 12:03:16.137389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5770): Terminating (SIGTERM) 12:03:16.180050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5773): Terminating (SIGTERM) 12:03:16.224584 --- ParallelTerminationStrategy: PID 5767 died... 12:03:16.245052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5767): Terminated: ok {rc=0} 12:03:16.293186 --- ParallelTerminationStrategy: PID 5770 died... 12:03:16.313274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5770): Terminated: ok {rc=0} 12:03:16.359952 --- ParallelTerminationStrategy: PID 5773 died... 12:03:16.380095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5773): Terminated: ok {rc=0} 12:03:16.468142 bus /sierra_9: Setting Powered False 12:03:17.567138 bus /sierra_9: Setting Powered False 12:03:18.681478 bus /sierra_8: Setting Powered False 12:03:19.779874 bus /sierra_8: Setting Powered False 12:03:20.895845 bus /sierra_3: Setting Powered False 12:03:21.990527 bus /sierra_3: Setting Powered False 12:03:23.105657 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms --------------------------------------------------------------------- 12:03:24.380407 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:24.384708 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 12:03:24.418035 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 12:03:24.455824 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 12:03:24.540673 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 12:03:24.573101 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 12:03:24.611065 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 12:03:25.198431 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 12:03:25.247594 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.258241 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:03:25.306319 tst cs_paging_gprs_active.py: using LAC 28264 12:03:25.425294 tst cs_paging_gprs_active.py: using RAC 214 12:03:25.543080 tst cs_paging_gprs_active.py: using CellId 28264 12:03:25.661402 tst cs_paging_gprs_active.py: using BVCI 28265 12:03:25.769393 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.779851 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.790110 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.800908 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.811490 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.821900 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.832465 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.842868 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:25.853455 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:03:25.970909 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:03:26.085621 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:03:26.287731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:03:26.588929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5779): Launched 12:03:26.850000 run iperf3-srv_10.42.42.10(pid=5780): Launched 12:03:26.962566 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:03:27.163636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:03:27.464265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5781): Launched 12:03:27.725689 run iperf3-srv_10.42.42.10(pid=5782): Launched 12:03:27.837791 tst cs_paging_gprs_active.py:38: start network... 12:03:28.037753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:28.501054 run create_hlr_db(pid=5783): Launched 12:03:28.616745 bus /sierra_2: Setting Powered False 12:03:29.677347 run create_hlr_db(pid=5783): Terminated: ok {rc=0} 12:03:30.117945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5785): Launched 12:03:30.441859 run osmo-hlr_10.42.42.2(pid=5786): Launched 12:03:30.564740 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:31.138203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5788): Launched 12:03:31.482471 run osmo-stp_10.42.42.5(pid=5789): Launched 12:03:31.738727 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:03:32.394689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5791): Launched 12:03:32.519272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:03:32.791733 run patchelf(pid=5792): Launched 12:03:32.970699 run osmo-stp_10.42.42.5(pid=5789): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5789)] 12:03:33.107643 run osmo-stp_10.42.42.5(pid=5789): stdout: | (launched: 2022-12-10_12:03:31.417957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:33.245382 run osmo-stp_10.42.42.5(pid=5789): stderr: | 20221210120331783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120331783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120331784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120331784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120331787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120331787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120331787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:33.383578 run osmo-stp_10.42.42.5(pid=5789): stdout: | (launched: 2022-12-10_12:03:31.417957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:33.515596 run osmo-stp_10.42.42.5(pid=5789): stderr: | 20221210120331783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120331783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120331784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120331784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120331787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120331787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120331787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:33.672021 run patchelf(pid=5792): Terminating (SIGINT) 12:03:33.851991 run patchelf(pid=5792): Terminated: ok {rc=0} 12:03:33.981795 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5789): Process ended prematurely: osmo-stp_10.42.42.5(pid=5789) [trial-2374↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5789)] [trial-2374↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 12:03:33.991835 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:03:34.020505 run osmo-hlr_10.42.42.2(pid=5786): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5786)] 12:03:34.070892 run osmo-hlr_10.42.42.2(pid=5786): stdout: | (launched: 2022-12-10_12:03:30.381867) 12:03:34.122816 run osmo-hlr_10.42.42.2(pid=5786): stderr: | 20221210120330582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120330582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120330582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120330582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120330582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120330582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120330593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120330602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120330602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120330602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:34.175310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5779): Terminating (SIGTERM) 12:03:34.217812 run iperf3-srv_10.42.42.10(pid=5780): Terminating (SIGTERM) 12:03:34.259997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5781): Terminating (SIGTERM) 12:03:34.302376 run iperf3-srv_10.42.42.10(pid=5782): Terminating (SIGTERM) 12:03:34.344340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5785): Terminating (SIGTERM) 12:03:34.386405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5788): Terminating (SIGTERM) 12:03:34.428229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5791): Terminating (SIGTERM) 12:03:34.470603 --- ParallelTerminationStrategy: PID 5779 died... 12:03:34.490615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5779): Terminated: ok {rc=0} 12:03:34.537347 --- ParallelTerminationStrategy: PID 5780 died... 12:03:34.557031 run iperf3-srv_10.42.42.10(pid=5780): Terminated {rc=256} 12:03:34.603448 --- ParallelTerminationStrategy: PID 5781 died... 12:03:34.623117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5781): Terminated: ok {rc=0} 12:03:34.669466 --- ParallelTerminationStrategy: PID 5782 died... 12:03:34.688844 run iperf3-srv_10.42.42.10(pid=5782): Terminated {rc=256} 12:03:34.735337 --- ParallelTerminationStrategy: PID 5785 died... 12:03:34.754892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5785): Terminated: ok {rc=0} 12:03:34.801014 --- ParallelTerminationStrategy: PID 5788 died... 12:03:34.820752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5788): Terminated: ok {rc=0} 12:03:34.867185 --- ParallelTerminationStrategy: PID 5791 died... 12:03:34.886890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5791): Terminated: ok {rc=0} 12:03:34.975187 bus /gobi_0: Setting Powered False 12:03:36.075949 bus /gobi_0: Setting Powered False 12:03:37.192811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms iperf3.py ---------------------------------------------- 12:03:38.342393 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.353906 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:03:38.406244 tst iperf3.py: using LAC 28265 12:03:38.533774 tst iperf3.py: using RAC 215 12:03:38.659984 tst iperf3.py: using CellId 28265 12:03:38.785752 tst iperf3.py: using BVCI 28266 12:03:38.901959 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.912899 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.923735 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.934545 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.945208 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.955814 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.966732 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.977404 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:38.988180 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:03:39.102587 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:03:39.305501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:03:39.609573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5793): Launched 12:03:39.871998 run iperf3-srv_10.42.42.10(pid=5794): Launched 12:03:39.991720 tst iperf3.py:8: start network... 12:03:40.210395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:40.709470 run create_hlr_db(pid=5795): Launched 12:03:40.840142 bus /gobi_6: Setting Powered False 12:03:41.904528 run create_hlr_db(pid=5795): Terminated: ok {rc=0} 12:03:42.352351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5797): Launched 12:03:42.675795 run osmo-hlr_10.42.42.2(pid=5798): Launched 12:03:42.799152 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:43.352516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5800): Launched 12:03:43.673556 run osmo-stp_10.42.42.5(pid=5801): Launched 12:03:43.796553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:03:44.350856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5803): Launched 12:03:44.474287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:03:44.745779 run patchelf(pid=5804): Launched 12:03:44.924838 run osmo-stp_10.42.42.5(pid=5801): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5801)] 12:03:45.061448 run osmo-stp_10.42.42.5(pid=5801): stdout: | (launched: 2022-12-10_12:03:43.615246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:45.199395 run osmo-stp_10.42.42.5(pid=5801): stderr: | 20221210120343807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120343807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120343807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120343808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120343808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120343808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120343808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:45.337829 run osmo-stp_10.42.42.5(pid=5801): stdout: | (launched: 2022-12-10_12:03:43.615246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:45.470429 run osmo-stp_10.42.42.5(pid=5801): stderr: | 20221210120343807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120343807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120343807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120343808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120343808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120343808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120343808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:45.626949 run patchelf(pid=5804): Terminating (SIGINT) 12:03:45.807372 run patchelf(pid=5804): Terminated: ok {rc=0} 12:03:45.945154 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5801): Process ended prematurely: osmo-stp_10.42.42.5(pid=5801) [trial-2374↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5801)] [trial-2374↪gprs:trx-lms↪iperf3.py:8] 12:03:45.955699 tst iperf3.py:8: Test FAILED (7.7 sec) 12:03:45.985224 run osmo-hlr_10.42.42.2(pid=5798): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5798)] 12:03:46.036649 run osmo-hlr_10.42.42.2(pid=5798): stdout: | (launched: 2022-12-10_12:03:42.616762) 12:03:46.090275 run osmo-hlr_10.42.42.2(pid=5798): stderr: | 20221210120342818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120342818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120342818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120342818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120342818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120342818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120342829 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120342837 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120342837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120342837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:46.144361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5793): Terminating (SIGTERM) 12:03:46.187709 run iperf3-srv_10.42.42.10(pid=5794): Terminating (SIGTERM) 12:03:46.233256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5797): Terminating (SIGTERM) 12:03:46.276537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5800): Terminating (SIGTERM) 12:03:46.319724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5803): Terminating (SIGTERM) 12:03:46.364397 --- ParallelTerminationStrategy: PID 5793 died... 12:03:46.384846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5793): Terminated: ok {rc=0} 12:03:46.432200 --- ParallelTerminationStrategy: PID 5794 died... 12:03:46.452335 run iperf3-srv_10.42.42.10(pid=5794): Terminated {rc=256} 12:03:46.499543 --- ParallelTerminationStrategy: PID 5797 died... 12:03:46.519711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5797): Terminated: ok {rc=0} 12:03:46.567291 --- ParallelTerminationStrategy: PID 5800 died... 12:03:46.587446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5800): Terminated: ok {rc=0} 12:03:46.634854 --- ParallelTerminationStrategy: PID 5803 died... 12:03:46.654996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5803): Terminated: ok {rc=0} 12:03:46.745757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms iperf3m4.py ---------------------------------------------- 12:03:47.897041 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:47.908602 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:03:47.958586 tst iperf3m4.py: using LAC 28266 12:03:48.086810 tst iperf3m4.py: using RAC 216 12:03:48.214670 tst iperf3m4.py: using CellId 28266 12:03:48.340274 tst iperf3m4.py: using BVCI 28267 12:03:48.458021 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.469250 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.480081 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.491051 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.501907 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.512555 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.523592 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.534536 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:03:48.545532 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:03:48.659303 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:03:48.784461 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:03:48.899527 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:03:49.017071 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:03:49.235599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:03:49.558588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5805): Launched 12:03:49.821396 run iperf3-srv_10.42.42.10(pid=5806): Launched 12:03:49.934134 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:03:50.135057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:03:50.436258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5807): Launched 12:03:50.698105 run iperf3-srv_10.42.42.10(pid=5808): Launched 12:03:50.810825 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:03:51.011713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:03:51.312597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5809): Launched 12:03:51.574586 run iperf3-srv_10.42.42.10(pid=5810): Launched 12:03:51.687175 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:03:51.887415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:03:52.187515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5811): Launched 12:03:52.448704 run iperf3-srv_10.42.42.10(pid=5812): Launched 12:03:52.561402 tst iperf3m4.py:8: start network... 12:03:52.762397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:53.225469 run create_hlr_db(pid=5813): Launched 12:03:53.342522 bus /gobi_6: Setting Powered False 12:03:54.402825 run create_hlr_db(pid=5813): Terminated: ok {rc=0} 12:03:54.821368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5815): Launched 12:03:55.122829 run osmo-hlr_10.42.42.2(pid=5816): Launched 12:03:55.237512 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:55.771853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5818): Launched 12:03:56.071900 run osmo-stp_10.42.42.5(pid=5819): Launched 12:03:56.186964 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:03:56.702887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5821): Launched 12:03:56.817209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:03:57.070023 run patchelf(pid=5822): Launched 12:03:57.236790 run osmo-stp_10.42.42.5(pid=5819): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5819)] 12:03:57.363693 run osmo-stp_10.42.42.5(pid=5819): stdout: | (launched: 2022-12-10_12:03:56.016534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:57.492166 run osmo-stp_10.42.42.5(pid=5819): stderr: | 20221210120356187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120356187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120356187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120356188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120356188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120356188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120356188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:57.620817 run osmo-stp_10.42.42.5(pid=5819): stdout: | (launched: 2022-12-10_12:03:56.016534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:57.743831 run osmo-stp_10.42.42.5(pid=5819): stderr: | 20221210120356187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120356187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120356187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120356188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120356188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120356188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120356188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:57.889449 run patchelf(pid=5822): Terminating (SIGINT) 12:03:58.057943 run patchelf(pid=5822): Terminated: ok {rc=0} 12:03:58.180127 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5819): Process ended prematurely: osmo-stp_10.42.42.5(pid=5819) [trial-2374↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5819)] [trial-2374↪gprs:trx-lms↪iperf3m4.py:8] 12:03:58.189617 tst iperf3m4.py:8: Test FAILED (10.3 sec) 12:03:58.217570 run osmo-hlr_10.42.42.2(pid=5816): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5816)] 12:03:58.265153 run osmo-hlr_10.42.42.2(pid=5816): stdout: | (launched: 2022-12-10_12:03:55.066524) 12:03:58.314478 run osmo-hlr_10.42.42.2(pid=5816): stderr: | 20221210120355243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120355243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120355243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120355243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120355243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120355243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120355255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120355264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120355264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120355264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:58.364032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5805): Terminating (SIGTERM) 12:03:58.403561 run iperf3-srv_10.42.42.10(pid=5806): Terminating (SIGTERM) 12:03:58.443234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5807): Terminating (SIGTERM) 12:03:58.482702 run iperf3-srv_10.42.42.10(pid=5808): Terminating (SIGTERM) 12:03:58.522019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5809): Terminating (SIGTERM) 12:03:58.561599 run iperf3-srv_10.42.42.10(pid=5810): Terminating (SIGTERM) 12:03:58.601259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5811): Terminating (SIGTERM) 12:03:58.640814 run iperf3-srv_10.42.42.10(pid=5812): Terminating (SIGTERM) 12:03:58.680301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5815): Terminating (SIGTERM) 12:03:58.719819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5818): Terminating (SIGTERM) 12:03:58.759119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5821): Terminating (SIGTERM) 12:03:58.798885 --- ParallelTerminationStrategy: PID 5805 died... 12:03:58.817820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5805): Terminated: ok {rc=0} 12:03:58.861870 --- ParallelTerminationStrategy: PID 5806 died... 12:03:58.880523 run iperf3-srv_10.42.42.10(pid=5806): Terminated {rc=256} 12:03:58.924328 --- ParallelTerminationStrategy: PID 5807 died... 12:03:58.942828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5807): Terminated: ok {rc=0} 12:03:58.986801 --- ParallelTerminationStrategy: PID 5808 died... 12:03:59.005335 run iperf3-srv_10.42.42.10(pid=5808): Terminated {rc=256} 12:03:59.049186 --- ParallelTerminationStrategy: PID 5809 died... 12:03:59.067537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5809): Terminated: ok {rc=0} 12:03:59.111579 --- ParallelTerminationStrategy: PID 5810 died... 12:03:59.129972 run iperf3-srv_10.42.42.10(pid=5810): Terminated {rc=256} 12:03:59.173720 --- ParallelTerminationStrategy: PID 5811 died... 12:03:59.192190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5811): Terminated: ok {rc=0} 12:03:59.236604 --- ParallelTerminationStrategy: PID 5812 died... 12:03:59.255080 run iperf3-srv_10.42.42.10(pid=5812): Terminated {rc=256} 12:03:59.298814 --- ParallelTerminationStrategy: PID 5815 died... 12:03:59.317497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5815): Terminated: ok {rc=0} 12:03:59.362210 --- ParallelTerminationStrategy: PID 5818 died... 12:03:59.380642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5818): Terminated: ok {rc=0} 12:03:59.424838 --- ParallelTerminationStrategy: PID 5821 died... 12:03:59.443813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5821): Terminated: ok {rc=0} 12:03:59.527752 bus /gobi_4: Setting Powered False 12:04:00.622516 bus /gobi_4: Setting Powered False 12:04:01.734356 bus /gobi_1: Setting Powered False 12:04:02.834455 bus /gobi_1: Setting Powered False 12:04:03.950573 bus /gobi_0: Setting Powered False 12:04:05.048534 bus /gobi_0: Setting Powered False 12:04:06.166295 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms ping.py ---------------------------------------------- 12:04:07.268874 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.280471 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:04:07.330833 tst ping.py: using LAC 28267 12:04:07.456002 tst ping.py: using RAC 217 12:04:07.579093 tst ping.py: using CellId 28267 12:04:07.704680 tst ping.py: using BVCI 28268 12:04:07.813596 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.824160 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.834539 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.845702 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.856418 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.867329 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.878502 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:07.889451 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:04:08.003126 tst ping.py:19: start network... 12:04:08.200423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:08.658388 run create_hlr_db(pid=5825): Launched 12:04:08.779944 bus /gobi_6: Setting Powered False 12:04:09.839301 run create_hlr_db(pid=5825): Terminated: ok {rc=0} 12:04:10.272123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5827): Launched 12:04:10.587684 run osmo-hlr_10.42.42.2(pid=5828): Launched 12:04:10.707446 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:11.256297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5830): Launched 12:04:11.572653 run osmo-stp_10.42.42.5(pid=5831): Launched 12:04:11.694245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:04:12.238193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5833): Launched 12:04:12.358863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:04:12.626268 run patchelf(pid=5834): Launched 12:04:12.802119 run osmo-stp_10.42.42.5(pid=5831): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5831)] 12:04:12.935621 run osmo-stp_10.42.42.5(pid=5831): stdout: | (launched: 2022-12-10_12:04:11.514676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:13.071237 run osmo-stp_10.42.42.5(pid=5831): stderr: | 20221210120411708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120411708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120411708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120411709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120411709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120411709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120411709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:13.207501 run osmo-stp_10.42.42.5(pid=5831): stdout: | (launched: 2022-12-10_12:04:11.514676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:13.337597 run osmo-stp_10.42.42.5(pid=5831): stderr: | 20221210120411708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120411708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120411708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120411709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120411709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120411709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120411709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:13.491266 run patchelf(pid=5834): Terminating (SIGINT) 12:04:13.668048 run patchelf(pid=5834): Terminated: ok {rc=0} 12:04:13.795070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5831): Process ended prematurely: osmo-stp_10.42.42.5(pid=5831) [trial-2374↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5831)] [trial-2374↪gprs:trx-lms↪ping.py:22] 12:04:13.804832 tst ping.py:22: Test FAILED (6.5 sec) 12:04:13.833192 run osmo-hlr_10.42.42.2(pid=5828): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5828)] 12:04:13.883171 run osmo-hlr_10.42.42.2(pid=5828): stdout: | (launched: 2022-12-10_12:04:10.529918) 12:04:13.935007 run osmo-hlr_10.42.42.2(pid=5828): stderr: | 20221210120410727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120410727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120410727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120410727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120410727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120410727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120410752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120410763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120410763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120410763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:13.987179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5827): Terminating (SIGTERM) 12:04:14.028932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5830): Terminating (SIGTERM) 12:04:14.070620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5833): Terminating (SIGTERM) 12:04:14.113008 --- ParallelTerminationStrategy: PID 5827 died... 12:04:14.133150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5827): Terminated: ok {rc=0} 12:04:14.179568 --- ParallelTerminationStrategy: PID 5830 died... 12:04:14.198987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5830): Terminated: ok {rc=0} 12:04:14.244756 --- ParallelTerminationStrategy: PID 5833 died... 12:04:14.264406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5833): Terminated: ok {rc=0} 12:04:14.352068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 12:04:15.439359 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:15.451050 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:04:15.505360 tst ping_idle_ping.py: using LAC 28268 12:04:15.629391 tst ping_idle_ping.py: using RAC 218 12:04:15.751442 tst ping_idle_ping.py: using CellId 28268 12:04:15.880463 tst ping_idle_ping.py: using BVCI 28269 12:04:16.014627 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:16.026166 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:16.037766 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:16.049417 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:16.060823 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:16.072265 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:16.084379 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:04:16.096016 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:04:16.213149 tst ping_idle_ping.py:24: start network... 12:04:16.433449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:16.944450 run create_hlr_db(pid=5835): Launched 12:04:17.108086 bus /gobi_6: Setting Powered False 12:04:18.170506 run create_hlr_db(pid=5835): Terminated: ok {rc=0} 12:04:18.613404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5837): Launched 12:04:18.929403 run osmo-hlr_10.42.42.2(pid=5838): Launched 12:04:19.051021 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:19.600735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5840): Launched 12:04:19.918716 run osmo-stp_10.42.42.5(pid=5841): Launched 12:04:20.040710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:04:20.586538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5843): Launched 12:04:20.707501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:04:20.974230 run patchelf(pid=5844): Launched 12:04:21.151027 run osmo-stp_10.42.42.5(pid=5841): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5841)] 12:04:21.285323 run osmo-stp_10.42.42.5(pid=5841): stdout: | (launched: 2022-12-10_12:04:19.860750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:21.421637 run osmo-stp_10.42.42.5(pid=5841): stderr: | 20221210120420050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120420050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120420051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120420051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120420051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120420052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120420052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:21.557688 run osmo-stp_10.42.42.5(pid=5841): stdout: | (launched: 2022-12-10_12:04:19.860750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:21.688291 run osmo-stp_10.42.42.5(pid=5841): stderr: | 20221210120420050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120420050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120420051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120420051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120420051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120420052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120420052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:21.843470 run patchelf(pid=5844): Terminating (SIGINT) 12:04:22.021141 run patchelf(pid=5844): Terminated: ok {rc=0} 12:04:22.149524 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5841): Process ended prematurely: osmo-stp_10.42.42.5(pid=5841) [trial-2374↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5841)] [trial-2374↪gprs:trx-lms↪ping_idle_ping.py:27] 12:04:22.158973 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:04:22.187210 run osmo-hlr_10.42.42.2(pid=5838): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5838)] 12:04:22.237363 run osmo-hlr_10.42.42.2(pid=5838): stdout: | (launched: 2022-12-10_12:04:18.871678) 12:04:22.289082 run osmo-hlr_10.42.42.2(pid=5838): stderr: | 20221210120419069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120419069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120419069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120419069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120419069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120419069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120419081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120419089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120419090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120419090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:22.341239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5837): Terminating (SIGTERM) 12:04:22.382690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5840): Terminating (SIGTERM) 12:04:22.424390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5843): Terminating (SIGTERM) 12:04:22.466393 --- ParallelTerminationStrategy: PID 5837 died... 12:04:22.486173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5837): Terminated: ok {rc=0} 12:04:22.532723 --- ParallelTerminationStrategy: PID 5840 died... 12:04:22.552242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5840): Terminated: ok {rc=0} 12:04:22.598810 --- ParallelTerminationStrategy: PID 5843 died... 12:04:22.618323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5843): Terminated: ok {rc=0} 12:04:22.706267 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 12:04:24.010596 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:24.016388 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:04:24.050541 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:04:24.090306 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:04:24.177269 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:04:24.211159 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:04:24.250601 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:04:24.843985 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:04:24.896575 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:24.907940 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:04:24.957720 tst cs_paging_gprs_active.py: using LAC 28269 12:04:25.078303 tst cs_paging_gprs_active.py: using RAC 219 12:04:25.194702 tst cs_paging_gprs_active.py: using CellId 28269 12:04:25.313149 tst cs_paging_gprs_active.py: using BVCI 28270 12:04:25.422011 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.432619 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.443104 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.453619 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.463910 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.474358 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.484879 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.495229 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:25.505812 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:04:25.624158 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:04:25.743429 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:04:25.946887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:26.249612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5848): Launched 12:04:26.511508 run iperf3-srv_10.42.42.10(pid=5849): Launched 12:04:26.624534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:04:26.826272 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:27.128295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5850): Launched 12:04:27.390503 run iperf3-srv_10.42.42.10(pid=5851): Launched 12:04:27.503214 tst cs_paging_gprs_active.py:38: start network... 12:04:27.704658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:28.171296 run create_hlr_db(pid=5852): Launched 12:04:28.294822 bus /gobi_6: Setting Powered False 12:04:29.355320 run create_hlr_db(pid=5852): Terminated: ok {rc=0} 12:04:29.794891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5854): Launched 12:04:30.117327 run osmo-hlr_10.42.42.2(pid=5855): Launched 12:04:30.240717 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:30.794254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5857): Launched 12:04:31.131674 run osmo-stp_10.42.42.5(pid=5858): Launched 12:04:31.323222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:04:31.966946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5860): Launched 12:04:32.095093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:04:32.372797 run patchelf(pid=5861): Launched 12:04:32.554818 run osmo-stp_10.42.42.5(pid=5858): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5858)] 12:04:32.692800 run osmo-stp_10.42.42.5(pid=5858): stdout: | (launched: 2022-12-10_12:04:31.067424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:32.831612 run osmo-stp_10.42.42.5(pid=5858): stderr: | 20221210120431410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120431411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120431411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120431411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120431420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120431420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120431420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:32.970606 run osmo-stp_10.42.42.5(pid=5858): stdout: | (launched: 2022-12-10_12:04:31.067424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:33.104070 run osmo-stp_10.42.42.5(pid=5858): stderr: | 20221210120431410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120431411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120431411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120431411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120431420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120431420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120431420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:33.262139 run patchelf(pid=5861): Terminating (SIGINT) 12:04:33.444091 run patchelf(pid=5861): Terminated: ok {rc=0} 12:04:33.575556 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5858): Process ended prematurely: osmo-stp_10.42.42.5(pid=5858) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5858)] [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:04:33.585703 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:04:33.616071 run osmo-hlr_10.42.42.2(pid=5855): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5855)] 12:04:33.666942 run osmo-hlr_10.42.42.2(pid=5855): stdout: | (launched: 2022-12-10_12:04:30.058064) 12:04:33.719615 run osmo-hlr_10.42.42.2(pid=5855): stderr: | 20221210120430259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120430259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120430259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120430259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120430259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120430260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120430272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120430280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120430281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120430281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:33.772576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5848): Terminating (SIGTERM) 12:04:33.815252 run iperf3-srv_10.42.42.10(pid=5849): Terminating (SIGTERM) 12:04:33.858257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5850): Terminating (SIGTERM) 12:04:33.900846 run iperf3-srv_10.42.42.10(pid=5851): Terminating (SIGTERM) 12:04:33.943876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5854): Terminating (SIGTERM) 12:04:33.986625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5857): Terminating (SIGTERM) 12:04:34.029287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5860): Terminating (SIGTERM) 12:04:34.072188 --- ParallelTerminationStrategy: PID 5848 died... 12:04:34.092208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5848): Terminated: ok {rc=0} 12:04:34.140438 --- ParallelTerminationStrategy: PID 5849 died... 12:04:34.159791 run iperf3-srv_10.42.42.10(pid=5849): Terminated {rc=256} 12:04:34.207617 --- ParallelTerminationStrategy: PID 5850 died... 12:04:34.227131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5850): Terminated: ok {rc=0} 12:04:34.274646 --- ParallelTerminationStrategy: PID 5851 died... 12:04:34.294153 run iperf3-srv_10.42.42.10(pid=5851): Terminated {rc=256} 12:04:34.341689 --- ParallelTerminationStrategy: PID 5854 died... 12:04:34.361490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5854): Terminated: ok {rc=0} 12:04:34.408783 --- ParallelTerminationStrategy: PID 5857 died... 12:04:34.428726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5857): Terminated: ok {rc=0} 12:04:34.476092 --- ParallelTerminationStrategy: PID 5860 died... 12:04:34.495543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5860): Terminated: ok {rc=0} 12:04:34.584075 bus /gobi_0: Setting Powered False 12:04:35.681800 bus /gobi_0: Setting Powered False 12:04:36.796664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:04:37.945393 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:37.957405 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:04:38.009712 tst iperf3.py: using LAC 28270 12:04:38.137134 tst iperf3.py: using RAC 220 12:04:38.263026 tst iperf3.py: using CellId 28270 12:04:38.389136 tst iperf3.py: using BVCI 28271 12:04:38.506093 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.517447 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.528313 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.539528 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.550675 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.561868 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.573388 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.586489 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:38.598192 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:04:38.737517 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:04:38.941604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:39.244775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5867): Launched 12:04:39.507640 run iperf3-srv_10.42.42.10(pid=5868): Launched 12:04:39.620919 tst iperf3.py:8: start network... 12:04:39.822758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:40.288497 run create_hlr_db(pid=5869): Launched 12:04:40.411698 bus /gobi_6: Setting Powered False 12:04:41.471424 run create_hlr_db(pid=5869): Terminated: ok {rc=0} 12:04:41.891566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5871): Launched 12:04:42.190977 run osmo-hlr_10.42.42.2(pid=5872): Launched 12:04:42.304345 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:42.819089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5874): Launched 12:04:43.119755 run osmo-stp_10.42.42.5(pid=5875): Launched 12:04:43.233763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:04:43.751656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5877): Launched 12:04:43.866196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:04:44.119674 run patchelf(pid=5878): Launched 12:04:44.287587 run osmo-stp_10.42.42.5(pid=5875): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5875)] 12:04:44.414596 run osmo-stp_10.42.42.5(pid=5875): stdout: | (launched: 2022-12-10_12:04:43.063961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:44.543303 run osmo-stp_10.42.42.5(pid=5875): stderr: | 20221210120443234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120443234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120443234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120443235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120443237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120443237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120443237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:44.671606 run osmo-stp_10.42.42.5(pid=5875): stdout: | (launched: 2022-12-10_12:04:43.063961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:44.794037 run osmo-stp_10.42.42.5(pid=5875): stderr: | 20221210120443234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120443234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120443234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120443235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120443237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120443237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120443237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:44.939597 run patchelf(pid=5878): Terminating (SIGINT) 12:04:45.108010 run patchelf(pid=5878): Terminated: ok {rc=0} 12:04:45.229563 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5875): Process ended prematurely: osmo-stp_10.42.42.5(pid=5875) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5875)] [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 12:04:45.238843 tst iperf3.py:8: Test FAILED (7.3 sec) 12:04:45.265944 run osmo-hlr_10.42.42.2(pid=5872): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5872)] 12:04:45.313560 run osmo-hlr_10.42.42.2(pid=5872): stdout: | (launched: 2022-12-10_12:04:42.136093) 12:04:45.362790 run osmo-hlr_10.42.42.2(pid=5872): stderr: | 20221210120442311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120442311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120442311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120442311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120442311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120442311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120442323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120442334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120442334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120442334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:45.412484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5867): Terminating (SIGTERM) 12:04:45.452278 run iperf3-srv_10.42.42.10(pid=5868): Terminating (SIGTERM) 12:04:45.491953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5871): Terminating (SIGTERM) 12:04:45.531691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5874): Terminating (SIGTERM) 12:04:45.571410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5877): Terminating (SIGTERM) 12:04:45.611403 --- ParallelTerminationStrategy: PID 5867 died... 12:04:45.630329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5867): Terminated: ok {rc=0} 12:04:45.674609 --- ParallelTerminationStrategy: PID 5868 died... 12:04:45.693249 run iperf3-srv_10.42.42.10(pid=5868): Terminated {rc=256} 12:04:45.736696 --- ParallelTerminationStrategy: PID 5871 died... 12:04:45.755294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5871): Terminated: ok {rc=0} 12:04:45.798988 --- ParallelTerminationStrategy: PID 5874 died... 12:04:45.817561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5874): Terminated: ok {rc=0} 12:04:45.875396 --- ParallelTerminationStrategy: PID 5877 died... 12:04:45.894570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5877): Terminated: ok {rc=0} 12:04:45.986868 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:04:47.143385 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.156248 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:04:47.213039 tst iperf3m4.py: using LAC 28271 12:04:47.346583 tst iperf3m4.py: using RAC 221 12:04:47.473936 tst iperf3m4.py: using CellId 28271 12:04:47.600056 tst iperf3m4.py: using BVCI 28272 12:04:47.716580 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.728058 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.739211 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.750625 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.761740 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.773082 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.784545 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.795911 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:04:47.807199 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:04:47.922526 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:04:48.044368 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:04:48.165250 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:04:48.280905 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:04:48.484710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:48.788446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5879): Launched 12:04:49.050688 run iperf3-srv_10.42.42.10(pid=5880): Launched 12:04:49.164828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:04:49.367868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:49.669606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5881): Launched 12:04:49.931810 run iperf3-srv_10.42.42.10(pid=5882): Launched 12:04:50.044677 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:04:50.245420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:50.545777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5883): Launched 12:04:50.806900 run iperf3-srv_10.42.42.10(pid=5884): Launched 12:04:50.919826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:04:51.120509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:51.421345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5885): Launched 12:04:51.682982 run iperf3-srv_10.42.42.10(pid=5886): Launched 12:04:51.795372 tst iperf3m4.py:8: start network... 12:04:51.996929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:52.461592 run create_hlr_db(pid=5887): Launched 12:04:52.586835 bus /gobi_6: Setting Powered False 12:04:53.647306 run create_hlr_db(pid=5887): Terminated: ok {rc=0} 12:04:54.088458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5889): Launched 12:04:54.412130 run osmo-hlr_10.42.42.2(pid=5890): Launched 12:04:54.536409 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:55.094267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5892): Launched 12:04:55.416693 run osmo-stp_10.42.42.5(pid=5893): Launched 12:04:55.539801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:04:56.094844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5895): Launched 12:04:56.218629 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:04:56.489623 run patchelf(pid=5896): Launched 12:04:56.668541 run osmo-stp_10.42.42.5(pid=5893): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5893)] 12:04:56.805098 run osmo-stp_10.42.42.5(pid=5893): stdout: | (launched: 2022-12-10_12:04:55.358144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:56.943222 run osmo-stp_10.42.42.5(pid=5893): stderr: | 20221210120455550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120455550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120455551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120455551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120455551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120455552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120455552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:57.081443 run osmo-stp_10.42.42.5(pid=5893): stdout: | (launched: 2022-12-10_12:04:55.358144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:57.214099 run osmo-stp_10.42.42.5(pid=5893): stderr: | 20221210120455550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120455550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120455551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120455551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120455551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120455552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120455552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:57.370569 run patchelf(pid=5896): Terminating (SIGINT) 12:04:57.551446 run patchelf(pid=5896): Terminated: ok {rc=0} 12:04:57.681491 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5893): Process ended prematurely: osmo-stp_10.42.42.5(pid=5893) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5893)] [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 12:04:57.691558 tst iperf3m4.py:8: Test FAILED (10.6 sec) 12:04:57.720735 run osmo-hlr_10.42.42.2(pid=5890): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5890)] 12:04:57.770855 run osmo-hlr_10.42.42.2(pid=5890): stdout: | (launched: 2022-12-10_12:04:54.353476) 12:04:57.822402 run osmo-hlr_10.42.42.2(pid=5890): stderr: | 20221210120454552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120454552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120454552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120454552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120454552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120454552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120454564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120454572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120454572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120454572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:57.874524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5879): Terminating (SIGTERM) 12:04:57.916213 run iperf3-srv_10.42.42.10(pid=5880): Terminating (SIGTERM) 12:04:57.957998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5881): Terminating (SIGTERM) 12:04:57.999697 run iperf3-srv_10.42.42.10(pid=5882): Terminating (SIGTERM) 12:04:58.041525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5883): Terminating (SIGTERM) 12:04:58.083253 run iperf3-srv_10.42.42.10(pid=5884): Terminating (SIGTERM) 12:04:58.125153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5885): Terminating (SIGTERM) 12:04:58.167120 run iperf3-srv_10.42.42.10(pid=5886): Terminating (SIGTERM) 12:04:58.208545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5889): Terminating (SIGTERM) 12:04:58.250314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5892): Terminating (SIGTERM) 12:04:58.291854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5895): Terminating (SIGTERM) 12:04:58.333679 --- ParallelTerminationStrategy: PID 5879 died... 12:04:58.353544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5879): Terminated: ok {rc=0} 12:04:58.399670 --- ParallelTerminationStrategy: PID 5880 died... 12:04:58.418965 run iperf3-srv_10.42.42.10(pid=5880): Terminated {rc=256} 12:04:58.464753 --- ParallelTerminationStrategy: PID 5881 died... 12:04:58.484076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5881): Terminated: ok {rc=0} 12:04:58.530227 --- ParallelTerminationStrategy: PID 5882 died... 12:04:58.549626 run iperf3-srv_10.42.42.10(pid=5882): Terminated {rc=256} 12:04:58.596056 --- ParallelTerminationStrategy: PID 5883 died... 12:04:58.615420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5883): Terminated: ok {rc=0} 12:04:58.662065 --- ParallelTerminationStrategy: PID 5884 died... 12:04:58.681570 run iperf3-srv_10.42.42.10(pid=5884): Terminated {rc=256} 12:04:58.727801 --- ParallelTerminationStrategy: PID 5885 died... 12:04:58.747227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5885): Terminated: ok {rc=0} 12:04:58.793708 --- ParallelTerminationStrategy: PID 5886 died... 12:04:58.813280 run iperf3-srv_10.42.42.10(pid=5886): Terminated {rc=256} 12:04:58.859490 --- ParallelTerminationStrategy: PID 5889 died... 12:04:58.878802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5889): Terminated: ok {rc=0} 12:04:58.924885 --- ParallelTerminationStrategy: PID 5892 died... 12:04:58.944552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5892): Terminated: ok {rc=0} 12:04:58.991315 --- ParallelTerminationStrategy: PID 5895 died... 12:04:59.010928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5895): Terminated: ok {rc=0} 12:04:59.099128 bus /gobi_4: Setting Powered False 12:05:00.197324 bus /gobi_4: Setting Powered False 12:05:01.311871 bus /gobi_1: Setting Powered False 12:05:02.411583 bus /gobi_1: Setting Powered False 12:05:03.527835 bus /gobi_0: Setting Powered False 12:05:04.626723 bus /gobi_0: Setting Powered False 12:05:05.742885 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 12:05:06.842961 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:06.854210 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:05:06.907918 tst ping.py: using LAC 28272 12:05:07.032368 tst ping.py: using RAC 222 12:05:07.155040 tst ping.py: using CellId 28272 12:05:07.277276 tst ping.py: using BVCI 28273 12:05:07.392106 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:07.403580 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:07.414856 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:07.426182 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:07.437421 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:07.448585 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:07.460090 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:07.471262 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:07.588464 tst ping.py:19: start network... 12:05:07.801073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:08.290269 run create_hlr_db(pid=5901): Launched 12:05:08.410437 bus /gobi_6: Setting Powered False 12:05:09.473328 run create_hlr_db(pid=5901): Terminated: ok {rc=0} 12:05:09.897733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5903): Launched 12:05:10.194148 run osmo-hlr_10.42.42.2(pid=5904): Launched 12:05:10.306312 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:10.817153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5906): Launched 12:05:11.112246 run osmo-stp_10.42.42.5(pid=5907): Launched 12:05:11.225497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:11.735487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5909): Launched 12:05:11.858069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:12.127816 run patchelf(pid=5910): Launched 12:05:12.305335 run osmo-stp_10.42.42.5(pid=5907): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5907)] 12:05:12.439641 run osmo-stp_10.42.42.5(pid=5907): stdout: | (launched: 2022-12-10_12:05:11.058133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:12.575529 run osmo-stp_10.42.42.5(pid=5907): stderr: | 20221210120511228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120511229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120511229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120511229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120511230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120511230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120511230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:12.711644 run osmo-stp_10.42.42.5(pid=5907): stdout: | (launched: 2022-12-10_12:05:11.058133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:12.841665 run osmo-stp_10.42.42.5(pid=5907): stderr: | 20221210120511228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120511229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120511229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120511229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120511230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120511230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120511230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:12.995773 run patchelf(pid=5910): Terminating (SIGINT) 12:05:13.173588 run patchelf(pid=5910): Terminated: ok {rc=0} 12:05:13.301384 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5907): Process ended prematurely: osmo-stp_10.42.42.5(pid=5907) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5907)] [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 12:05:13.310886 tst ping.py:22: Test FAILED (6.5 sec) 12:05:13.339700 run osmo-hlr_10.42.42.2(pid=5904): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5904)] 12:05:13.390228 run osmo-hlr_10.42.42.2(pid=5904): stdout: | (launched: 2022-12-10_12:05:10.139624) 12:05:13.442218 run osmo-hlr_10.42.42.2(pid=5904): stderr: | 20221210120510317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120510317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120510318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120510318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120510318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120510318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120510331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120510339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120510339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120510339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:13.494837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5903): Terminating (SIGTERM) 12:05:13.537128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5906): Terminating (SIGTERM) 12:05:13.579582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5909): Terminating (SIGTERM) 12:05:13.622325 --- ParallelTerminationStrategy: PID 5903 died... 12:05:13.642442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5903): Terminated: ok {rc=0} 12:05:13.689736 --- ParallelTerminationStrategy: PID 5906 died... 12:05:13.709545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5906): Terminated: ok {rc=0} 12:05:13.756346 --- ParallelTerminationStrategy: PID 5909 died... 12:05:13.776078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5909): Terminated: ok {rc=0} 12:05:13.864466 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:05:14.952589 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:14.964596 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:05:15.016313 tst ping_idle_ping.py: using LAC 28273 12:05:15.134227 tst ping_idle_ping.py: using RAC 223 12:05:15.253156 tst ping_idle_ping.py: using CellId 28273 12:05:15.370363 tst ping_idle_ping.py: using BVCI 28274 12:05:15.479580 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:15.490433 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:15.501029 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:15.511691 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:15.522364 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:15.532792 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:15.544002 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:15.554769 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:15.671654 tst ping_idle_ping.py:24: start network... 12:05:15.887223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:16.415000 run create_hlr_db(pid=5911): Launched 12:05:16.575967 bus /gobi_6: Setting Powered False 12:05:17.640227 run create_hlr_db(pid=5911): Terminated: ok {rc=0} 12:05:18.066924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5913): Launched 12:05:18.365983 run osmo-hlr_10.42.42.2(pid=5914): Launched 12:05:18.479750 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:19.001770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5916): Launched 12:05:19.298986 run osmo-stp_10.42.42.5(pid=5917): Launched 12:05:19.412090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:19.922595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5919): Launched 12:05:20.035557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:20.287706 run patchelf(pid=5920): Launched 12:05:20.453188 run osmo-stp_10.42.42.5(pid=5917): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5917)] 12:05:20.578605 run osmo-stp_10.42.42.5(pid=5917): stdout: | (launched: 2022-12-10_12:05:19.244338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:20.705676 run osmo-stp_10.42.42.5(pid=5917): stderr: | 20221210120519415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120519415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120519416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120519416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120519416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120519417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120519417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:20.832676 run osmo-stp_10.42.42.5(pid=5917): stdout: | (launched: 2022-12-10_12:05:19.244338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:20.954243 run osmo-stp_10.42.42.5(pid=5917): stderr: | 20221210120519415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120519415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120519416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120519416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120519416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120519417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120519417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:21.098172 run patchelf(pid=5920): Terminating (SIGINT) 12:05:21.264068 run patchelf(pid=5920): Terminated: ok {rc=0} 12:05:21.383804 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5917): Process ended prematurely: osmo-stp_10.42.42.5(pid=5917) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5917)] [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 12:05:21.392655 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:05:21.419606 run osmo-hlr_10.42.42.2(pid=5914): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5914)] 12:05:21.467286 run osmo-hlr_10.42.42.2(pid=5914): stdout: | (launched: 2022-12-10_12:05:18.311024) 12:05:21.517288 run osmo-hlr_10.42.42.2(pid=5914): stderr: | 20221210120518486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120518486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120518486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120518486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120518486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120518486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120518498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120518509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120518509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120518509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:21.567847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5913): Terminating (SIGTERM) 12:05:21.607917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5916): Terminating (SIGTERM) 12:05:21.647884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5919): Terminating (SIGTERM) 12:05:21.688225 --- ParallelTerminationStrategy: PID 5913 died... 12:05:21.707484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5913): Terminated: ok {rc=0} 12:05:21.751865 --- ParallelTerminationStrategy: PID 5916 died... 12:05:21.770754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5916): Terminated: ok {rc=0} 12:05:21.814875 --- ParallelTerminationStrategy: PID 5919 died... 12:05:21.833728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5919): Terminated: ok {rc=0} 12:05:21.919329 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:05:23.221393 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:05:23.227698 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:05:23.260320 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:05:23.298169 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:05:23.383367 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:05:23.415840 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:05:23.453549 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:05:24.044245 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:05:24.093206 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.103924 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:05:24.172614 tst cs_paging_gprs_active.py: using LAC 28274 12:05:24.291895 tst cs_paging_gprs_active.py: using RAC 224 12:05:24.410044 tst cs_paging_gprs_active.py: using CellId 28274 12:05:24.528605 tst cs_paging_gprs_active.py: using BVCI 28275 12:05:24.639370 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.650159 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.660656 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.671315 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.681843 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.692331 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.703470 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.713909 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:24.724542 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:05:24.841852 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:05:24.960630 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:05:25.180656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:25.505517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5924): Launched 12:05:25.786761 run iperf3-srv_10.42.42.10(pid=5925): Launched 12:05:25.908350 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:05:26.127192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:26.452056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5926): Launched 12:05:26.733924 run iperf3-srv_10.42.42.10(pid=5927): Launched 12:05:26.855184 tst cs_paging_gprs_active.py:38: start network... 12:05:27.073391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:27.574275 run create_hlr_db(pid=5928): Launched 12:05:27.698875 bus /gobi_6: Setting Powered False 12:05:28.762615 run create_hlr_db(pid=5928): Terminated: ok {rc=0} 12:05:29.212400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5930): Launched 12:05:29.534484 run osmo-hlr_10.42.42.2(pid=5931): Launched 12:05:29.658240 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:30.214663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5933): Launched 12:05:30.536911 run osmo-stp_10.42.42.5(pid=5934): Launched 12:05:30.660060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:31.242258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5936): Launched 12:05:31.378519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:31.669740 run patchelf(pid=5937): Launched 12:05:31.859702 run osmo-stp_10.42.42.5(pid=5934): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5934)] 12:05:32.000154 run osmo-stp_10.42.42.5(pid=5934): stdout: | (launched: 2022-12-10_12:05:30.478451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:32.142059 run osmo-stp_10.42.42.5(pid=5934): stderr: | 20221210120530672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120530672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120530672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120530673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120530673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120530673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120530673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:32.282040 run osmo-stp_10.42.42.5(pid=5934): stdout: | (launched: 2022-12-10_12:05:30.478451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:32.414897 run osmo-stp_10.42.42.5(pid=5934): stderr: | 20221210120530672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120530672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120530672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120530673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120530673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120530673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120530673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:32.571923 run patchelf(pid=5937): Terminating (SIGINT) 12:05:32.753653 run patchelf(pid=5937): Terminated: ok {rc=0} 12:05:32.884832 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5934): Process ended prematurely: osmo-stp_10.42.42.5(pid=5934) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5934)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:05:32.895231 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:05:32.924772 run osmo-hlr_10.42.42.2(pid=5931): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5931)] 12:05:32.975444 run osmo-hlr_10.42.42.2(pid=5931): stdout: | (launched: 2022-12-10_12:05:29.475381) 12:05:33.027709 run osmo-hlr_10.42.42.2(pid=5931): stderr: | 20221210120529672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120529672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120529672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120529672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120529672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120529672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120529687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120529697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120529697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120529697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:33.080585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5924): Terminating (SIGTERM) 12:05:33.123568 run iperf3-srv_10.42.42.10(pid=5925): Terminating (SIGTERM) 12:05:33.166340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5926): Terminating (SIGTERM) 12:05:33.208862 run iperf3-srv_10.42.42.10(pid=5927): Terminating (SIGTERM) 12:05:33.251200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5930): Terminating (SIGTERM) 12:05:33.293583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5933): Terminating (SIGTERM) 12:05:33.335813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5936): Terminating (SIGTERM) 12:05:33.378601 --- ParallelTerminationStrategy: PID 5924 died... 12:05:33.398893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5924): Terminated: ok {rc=0} 12:05:33.446172 --- ParallelTerminationStrategy: PID 5925 died... 12:05:33.465903 run iperf3-srv_10.42.42.10(pid=5925): Terminated {rc=256} 12:05:33.512695 --- ParallelTerminationStrategy: PID 5926 died... 12:05:33.532481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5926): Terminated: ok {rc=0} 12:05:33.579568 --- ParallelTerminationStrategy: PID 5927 died... 12:05:33.599278 run iperf3-srv_10.42.42.10(pid=5927): Terminated {rc=256} 12:05:33.646066 --- ParallelTerminationStrategy: PID 5930 died... 12:05:33.665880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5930): Terminated: ok {rc=0} 12:05:33.712786 --- ParallelTerminationStrategy: PID 5933 died... 12:05:33.732819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5933): Terminated: ok {rc=0} 12:05:33.779954 --- ParallelTerminationStrategy: PID 5936 died... 12:05:33.799741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5936): Terminated: ok {rc=0} 12:05:33.889153 bus /gobi_0: Setting Powered False 12:05:34.988577 bus /gobi_0: Setting Powered False 12:05:36.105233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:05:37.254962 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.267026 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:05:37.338021 tst iperf3.py: using LAC 28275 12:05:37.463621 tst iperf3.py: using RAC 225 12:05:37.582156 tst iperf3.py: using CellId 28275 12:05:37.700228 tst iperf3.py: using BVCI 28276 12:05:37.810916 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.821986 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.832544 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.843345 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.853864 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.864298 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.874925 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.885342 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:37.895850 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:05:38.013090 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:05:38.232450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:38.557285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5938): Launched 12:05:38.838766 run iperf3-srv_10.42.42.10(pid=5939): Launched 12:05:38.960931 tst iperf3.py:8: start network... 12:05:39.180121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:39.680106 run create_hlr_db(pid=5940): Launched 12:05:39.804376 bus /gobi_6: Setting Powered False 12:05:40.866365 run create_hlr_db(pid=5940): Terminated: ok {rc=0} 12:05:41.297735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5942): Launched 12:05:41.598237 run osmo-hlr_10.42.42.2(pid=5943): Launched 12:05:41.712476 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:42.230557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5945): Launched 12:05:42.532879 run osmo-stp_10.42.42.5(pid=5946): Launched 12:05:42.648226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:43.167614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5948): Launched 12:05:43.283095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:43.536832 run patchelf(pid=5949): Launched 12:05:43.704253 run osmo-stp_10.42.42.5(pid=5946): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5946)] 12:05:43.831342 run osmo-stp_10.42.42.5(pid=5946): stdout: | (launched: 2022-12-10_12:05:42.476880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:43.960068 run osmo-stp_10.42.42.5(pid=5946): stderr: | 20221210120542646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120542646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120542646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120542646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120542647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120542647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120542647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:44.088883 run osmo-stp_10.42.42.5(pid=5946): stdout: | (launched: 2022-12-10_12:05:42.476880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:44.211744 run osmo-stp_10.42.42.5(pid=5946): stderr: | 20221210120542646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120542646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120542646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120542646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120542647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120542647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120542647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:44.357269 run patchelf(pid=5949): Terminating (SIGINT) 12:05:44.526908 run patchelf(pid=5949): Terminated: ok {rc=0} 12:05:44.648672 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5946): Process ended prematurely: osmo-stp_10.42.42.5(pid=5946) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5946)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 12:05:44.658233 tst iperf3.py:8: Test FAILED (7.4 sec) 12:05:44.685271 run osmo-hlr_10.42.42.2(pid=5943): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5943)] 12:05:44.732894 run osmo-hlr_10.42.42.2(pid=5943): stdout: | (launched: 2022-12-10_12:05:41.543233) 12:05:44.781895 run osmo-hlr_10.42.42.2(pid=5943): stderr: | 20221210120541718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120541718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120541718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120541718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120541718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120541718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120541730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120541741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120541741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120541741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:44.831374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5938): Terminating (SIGTERM) 12:05:44.870980 run iperf3-srv_10.42.42.10(pid=5939): Terminating (SIGTERM) 12:05:44.910623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5942): Terminating (SIGTERM) 12:05:44.950243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5945): Terminating (SIGTERM) 12:05:44.989757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5948): Terminating (SIGTERM) 12:05:45.029773 --- ParallelTerminationStrategy: PID 5938 died... 12:05:45.048529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5938): Terminated: ok {rc=0} 12:05:45.092421 --- ParallelTerminationStrategy: PID 5939 died... 12:05:45.111126 run iperf3-srv_10.42.42.10(pid=5939): Terminated {rc=256} 12:05:45.154766 --- ParallelTerminationStrategy: PID 5942 died... 12:05:45.173378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5942): Terminated: ok {rc=0} 12:05:45.216837 --- ParallelTerminationStrategy: PID 5945 died... 12:05:45.235512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5945): Terminated: ok {rc=0} 12:05:45.279031 --- ParallelTerminationStrategy: PID 5948 died... 12:05:45.297480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5948): Terminated: ok {rc=0} 12:05:45.382931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:05:46.539284 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:46.552189 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:05:46.627394 tst iperf3m4.py: using LAC 28276 12:05:46.765676 tst iperf3m4.py: using RAC 226 12:05:46.898079 tst iperf3m4.py: using CellId 28276 12:05:47.052597 tst iperf3m4.py: using BVCI 28277 12:05:47.199077 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.210602 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.221717 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.233190 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.244769 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.256541 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.267961 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.279138 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:05:47.290475 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:05:47.406219 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:05:47.527250 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:05:47.641652 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:05:47.756185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:05:47.974949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:48.298405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5950): Launched 12:05:48.579445 run iperf3-srv_10.42.42.10(pid=5951): Launched 12:05:48.701000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:05:48.918388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:49.241453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5952): Launched 12:05:49.521558 run iperf3-srv_10.42.42.10(pid=5953): Launched 12:05:49.642354 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:05:49.859325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:50.182128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5954): Launched 12:05:50.462658 run iperf3-srv_10.42.42.10(pid=5955): Launched 12:05:50.583966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:05:50.800674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:51.122864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5956): Launched 12:05:51.401993 run iperf3-srv_10.42.42.10(pid=5957): Launched 12:05:51.523103 tst iperf3m4.py:8: start network... 12:05:51.740605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:52.240903 run create_hlr_db(pid=5958): Launched 12:05:52.363533 bus /gobi_6: Setting Powered False 12:05:53.427911 run create_hlr_db(pid=5958): Terminated: ok {rc=0} 12:05:53.858911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5960): Launched 12:05:54.159579 run osmo-hlr_10.42.42.2(pid=5961): Launched 12:05:54.274138 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:54.791940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5963): Launched 12:05:55.092302 run osmo-stp_10.42.42.5(pid=5964): Launched 12:05:55.207243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:55.723645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5966): Launched 12:05:55.838485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:56.091630 run patchelf(pid=5967): Launched 12:05:56.258998 run osmo-stp_10.42.42.5(pid=5964): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5964)] 12:05:56.385739 run osmo-stp_10.42.42.5(pid=5964): stdout: | (launched: 2022-12-10_12:05:55.037202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:56.514874 run osmo-stp_10.42.42.5(pid=5964): stderr: | 20221210120555210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120555210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120555210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120555210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120555211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120555211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120555211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:56.643322 run osmo-stp_10.42.42.5(pid=5964): stdout: | (launched: 2022-12-10_12:05:55.037202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:56.765988 run osmo-stp_10.42.42.5(pid=5964): stderr: | 20221210120555210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120555210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120555210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120555210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120555211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120555211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120555211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:56.911878 run patchelf(pid=5967): Terminating (SIGINT) 12:05:57.080731 run patchelf(pid=5967): Terminated: ok {rc=0} 12:05:57.202317 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5964): Process ended prematurely: osmo-stp_10.42.42.5(pid=5964) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5964)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:05:57.211663 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:05:57.239100 run osmo-hlr_10.42.42.2(pid=5961): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5961)] 12:05:57.286501 run osmo-hlr_10.42.42.2(pid=5961): stdout: | (launched: 2022-12-10_12:05:54.104420) 12:05:57.335397 run osmo-hlr_10.42.42.2(pid=5961): stderr: | 20221210120554278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120554278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120554278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120554278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120554278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120554278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120554290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120554301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120554301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120554301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:57.384562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5950): Terminating (SIGTERM) 12:05:57.424170 run iperf3-srv_10.42.42.10(pid=5951): Terminating (SIGTERM) 12:05:57.463626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5952): Terminating (SIGTERM) 12:05:57.503037 run iperf3-srv_10.42.42.10(pid=5953): Terminating (SIGTERM) 12:05:57.542424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5954): Terminating (SIGTERM) 12:05:57.581596 run iperf3-srv_10.42.42.10(pid=5955): Terminating (SIGTERM) 12:05:57.620812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5956): Terminating (SIGTERM) 12:05:57.660204 run iperf3-srv_10.42.42.10(pid=5957): Terminating (SIGTERM) 12:05:57.699588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5960): Terminating (SIGTERM) 12:05:57.738884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5963): Terminating (SIGTERM) 12:05:57.778424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5966): Terminating (SIGTERM) 12:05:57.818439 --- ParallelTerminationStrategy: PID 5950 died... 12:05:57.837648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5950): Terminated: ok {rc=0} 12:05:57.881891 --- ParallelTerminationStrategy: PID 5951 died... 12:05:57.900593 run iperf3-srv_10.42.42.10(pid=5951): Terminated {rc=256} 12:05:57.944399 --- ParallelTerminationStrategy: PID 5952 died... 12:05:57.963211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5952): Terminated: ok {rc=0} 12:05:58.007002 --- ParallelTerminationStrategy: PID 5953 died... 12:05:58.025635 run iperf3-srv_10.42.42.10(pid=5953): Terminated {rc=256} 12:05:58.069426 --- ParallelTerminationStrategy: PID 5954 died... 12:05:58.088118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5954): Terminated: ok {rc=0} 12:05:58.131872 --- ParallelTerminationStrategy: PID 5955 died... 12:05:58.150532 run iperf3-srv_10.42.42.10(pid=5955): Terminated {rc=256} 12:05:58.194678 --- ParallelTerminationStrategy: PID 5956 died... 12:05:58.213406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5956): Terminated: ok {rc=0} 12:05:58.257233 --- ParallelTerminationStrategy: PID 5957 died... 12:05:58.275873 run iperf3-srv_10.42.42.10(pid=5957): Terminated {rc=256} 12:05:58.319706 --- ParallelTerminationStrategy: PID 5960 died... 12:05:58.338588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5960): Terminated: ok {rc=0} 12:05:58.382411 --- ParallelTerminationStrategy: PID 5963 died... 12:05:58.401165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5963): Terminated: ok {rc=0} 12:05:58.445210 --- ParallelTerminationStrategy: PID 5966 died... 12:05:58.463920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5966): Terminated: ok {rc=0} 12:05:58.550359 bus /gobi_4: Setting Powered False 12:05:59.651663 bus /gobi_4: Setting Powered False 12:06:00.768627 bus /gobi_1: Setting Powered False 12:06:01.869514 bus /gobi_1: Setting Powered False 12:06:02.988505 bus /gobi_0: Setting Powered False 12:06:04.089255 bus /gobi_0: Setting Powered False 12:06:05.207326 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:06:06.311839 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.323187 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:06:06.392695 tst ping.py: using LAC 28277 12:06:06.508550 tst ping.py: using RAC 227 12:06:06.625649 tst ping.py: using CellId 28277 12:06:06.741317 tst ping.py: using BVCI 28278 12:06:06.848781 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.859693 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.870324 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.880888 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.891417 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.901939 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.912661 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:06.923215 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:07.038291 tst ping.py:19: start network... 12:06:07.251616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:07.741621 run create_hlr_db(pid=5968): Launched 12:06:07.863149 bus /gobi_6: Setting Powered False 12:06:08.926110 run create_hlr_db(pid=5968): Terminated: ok {rc=0} 12:06:09.367129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5970): Launched 12:06:09.683833 run osmo-hlr_10.42.42.2(pid=5971): Launched 12:06:09.805242 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:10.356769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5973): Launched 12:06:10.673261 run osmo-stp_10.42.42.5(pid=5974): Launched 12:06:10.795187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:11.343209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5976): Launched 12:06:11.464442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:11.733128 run patchelf(pid=5977): Launched 12:06:11.909056 run osmo-stp_10.42.42.5(pid=5974): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5974)] 12:06:12.043318 run osmo-stp_10.42.42.5(pid=5974): stdout: | (launched: 2022-12-10_12:06:10.615519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:12.179092 run osmo-stp_10.42.42.5(pid=5974): stderr: | 20221210120610807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120610807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120610808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120610808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120610809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120610809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120610809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:12.314757 run osmo-stp_10.42.42.5(pid=5974): stdout: | (launched: 2022-12-10_12:06:10.615519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:12.444541 run osmo-stp_10.42.42.5(pid=5974): stderr: | 20221210120610807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120610807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120610808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120610808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120610809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120610809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120610809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:12.598756 run patchelf(pid=5977): Terminating (SIGINT) 12:06:12.776058 run patchelf(pid=5977): Terminated: ok {rc=0} 12:06:12.903518 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5974): Process ended prematurely: osmo-stp_10.42.42.5(pid=5974) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5974)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 12:06:12.913108 tst ping.py:22: Test FAILED (6.6 sec) 12:06:12.943557 run osmo-hlr_10.42.42.2(pid=5971): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5971)] 12:06:12.991210 run osmo-hlr_10.42.42.2(pid=5971): stdout: | (launched: 2022-12-10_12:06:09.626035) 12:06:13.041211 run osmo-hlr_10.42.42.2(pid=5971): stderr: | 20221210120609822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120609822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120609822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120609822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120609822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120609822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120609834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120609843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120609843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120609843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:13.090811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5970): Terminating (SIGTERM) 12:06:13.131350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5973): Terminating (SIGTERM) 12:06:13.171207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5976): Terminating (SIGTERM) 12:06:13.211455 --- ParallelTerminationStrategy: PID 5970 died... 12:06:13.230533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5970): Terminated: ok {rc=0} 12:06:13.275990 --- ParallelTerminationStrategy: PID 5973 died... 12:06:13.294607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5973): Terminated: ok {rc=0} 12:06:13.339294 --- ParallelTerminationStrategy: PID 5976 died... 12:06:13.358797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5976): Terminated: ok {rc=0} 12:06:13.445166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:06:14.533111 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:14.544889 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:06:14.616292 tst ping_idle_ping.py: using LAC 28278 12:06:14.733540 tst ping_idle_ping.py: using RAC 228 12:06:14.859187 tst ping_idle_ping.py: using CellId 28278 12:06:14.982836 tst ping_idle_ping.py: using BVCI 28279 12:06:15.098411 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:15.109957 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:15.121300 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:15.132855 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:15.144881 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:15.156908 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:15.168662 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:15.180399 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:15.297303 tst ping_idle_ping.py:24: start network... 12:06:15.498342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:16.000516 run create_hlr_db(pid=5978): Launched 12:06:16.158213 bus /gobi_6: Setting Powered False 12:06:17.221997 run create_hlr_db(pid=5978): Terminated: ok {rc=0} 12:06:17.649890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5980): Launched 12:06:17.946831 run osmo-hlr_10.42.42.2(pid=5981): Launched 12:06:18.060514 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:18.570091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5983): Launched 12:06:18.867363 run osmo-stp_10.42.42.5(pid=5984): Launched 12:06:18.979738 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:19.491290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5986): Launched 12:06:19.604596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:19.855296 run patchelf(pid=5987): Launched 12:06:20.020779 run osmo-stp_10.42.42.5(pid=5984): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5984)] 12:06:20.146997 run osmo-stp_10.42.42.5(pid=5984): stdout: | (launched: 2022-12-10_12:06:18.812498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:20.274504 run osmo-stp_10.42.42.5(pid=5984): stderr: | 20221210120618983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120618983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120618983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120618984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120618984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120618984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120618984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:20.401809 run osmo-stp_10.42.42.5(pid=5984): stdout: | (launched: 2022-12-10_12:06:18.812498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:20.523888 run osmo-stp_10.42.42.5(pid=5984): stderr: | 20221210120618983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120618983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120618983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120618984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120618984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120618984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120618984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:20.668714 run patchelf(pid=5987): Terminating (SIGINT) 12:06:20.835396 run patchelf(pid=5987): Terminated: ok {rc=0} 12:06:20.955380 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5984): Process ended prematurely: osmo-stp_10.42.42.5(pid=5984) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5984)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:06:20.964181 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:06:20.990860 run osmo-hlr_10.42.42.2(pid=5981): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5981)] 12:06:21.038519 run osmo-hlr_10.42.42.2(pid=5981): stdout: | (launched: 2022-12-10_12:06:17.892029) 12:06:21.087843 run osmo-hlr_10.42.42.2(pid=5981): stderr: | 20221210120618065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120618066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120618066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120618066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120618066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120618066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120618078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120618086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120618087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120618087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:21.137849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5980): Terminating (SIGTERM) 12:06:21.178062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5983): Terminating (SIGTERM) 12:06:21.217993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5986): Terminating (SIGTERM) 12:06:21.257996 --- ParallelTerminationStrategy: PID 5980 died... 12:06:21.276867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5980): Terminated: ok {rc=0} 12:06:21.321093 --- ParallelTerminationStrategy: PID 5983 died... 12:06:21.339725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5983): Terminated: ok {rc=0} 12:06:21.383617 --- ParallelTerminationStrategy: PID 5986 died... 12:06:21.402282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5986): Terminated: ok {rc=0} 12:06:21.486108 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:06:22.796813 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:06:22.805572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:06:22.842344 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:06:22.882218 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:06:22.975518 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:06:23.010002 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:06:23.049985 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:06:23.636261 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:06:23.687420 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:23.698374 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:06:23.765918 tst cs_paging_gprs_active.py: using LAC 28279 12:06:23.882801 tst cs_paging_gprs_active.py: using RAC 229 12:06:24.001742 tst cs_paging_gprs_active.py: using CellId 28279 12:06:24.118335 tst cs_paging_gprs_active.py: using BVCI 28280 12:06:24.227536 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.238303 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.248815 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.259356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.269798 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.280282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.290879 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.301392 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:24.311954 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:06:24.427124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:06:24.550915 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:06:24.756506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:25.059841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5991): Launched 12:06:25.322416 run iperf3-srv_10.42.42.10(pid=5992): Launched 12:06:25.435499 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:06:25.637907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:25.939735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5993): Launched 12:06:26.202959 run iperf3-srv_10.42.42.10(pid=5994): Launched 12:06:26.316373 tst cs_paging_gprs_active.py:38: start network... 12:06:26.518401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:26.985804 run create_hlr_db(pid=5995): Launched 12:06:27.108584 bus /gobi_6: Setting Powered False 12:06:28.169951 run create_hlr_db(pid=5995): Terminated: ok {rc=0} 12:06:28.609271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5997): Launched 12:06:28.932033 run osmo-hlr_10.42.42.2(pid=5998): Launched 12:06:29.055666 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:29.613260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6000): Launched 12:06:29.937408 run osmo-stp_10.42.42.5(pid=6001): Launched 12:06:30.062170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:30.621224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6003): Launched 12:06:30.745631 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:31.035842 run patchelf(pid=6004): Launched 12:06:31.225874 run osmo-stp_10.42.42.5(pid=6001): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6001)] 12:06:31.358321 run osmo-stp_10.42.42.5(pid=6001): stdout: | (launched: 2022-12-10_12:06:29.877938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:31.492560 run osmo-stp_10.42.42.5(pid=6001): stderr: | 20221210120630068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120630068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120630068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120630069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120630069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120630069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120630069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:31.626243 run osmo-stp_10.42.42.5(pid=6001): stdout: | (launched: 2022-12-10_12:06:29.877938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:31.754414 run osmo-stp_10.42.42.5(pid=6001): stderr: | 20221210120630068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120630068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120630068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120630069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120630069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120630069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120630069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:31.904546 run patchelf(pid=6004): Terminating (SIGINT) 12:06:32.079268 run patchelf(pid=6004): Terminated: ok {rc=0} 12:06:32.203983 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6001): Process ended prematurely: osmo-stp_10.42.42.5(pid=6001) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6001)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:06:32.213683 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:06:32.241247 run osmo-hlr_10.42.42.2(pid=5998): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5998)] 12:06:32.289240 run osmo-hlr_10.42.42.2(pid=5998): stdout: | (launched: 2022-12-10_12:06:28.873621) 12:06:32.338470 run osmo-hlr_10.42.42.2(pid=5998): stderr: | 20221210120629070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120629070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120629070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120629070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120629070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120629070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120629082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120629090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120629091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120629091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:32.387919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5991): Terminating (SIGTERM) 12:06:32.427549 run iperf3-srv_10.42.42.10(pid=5992): Terminating (SIGTERM) 12:06:32.466852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5993): Terminating (SIGTERM) 12:06:32.506006 run iperf3-srv_10.42.42.10(pid=5994): Terminating (SIGTERM) 12:06:32.545327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5997): Terminating (SIGTERM) 12:06:32.585129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6000): Terminating (SIGTERM) 12:06:32.624456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6003): Terminating (SIGTERM) 12:06:32.664002 --- ParallelTerminationStrategy: PID 5991 died... 12:06:32.683070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5991): Terminated: ok {rc=0} 12:06:32.727087 --- ParallelTerminationStrategy: PID 5992 died... 12:06:32.745950 run iperf3-srv_10.42.42.10(pid=5992): Terminated {rc=256} 12:06:32.790049 --- ParallelTerminationStrategy: PID 5993 died... 12:06:32.808685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5993): Terminated: ok {rc=0} 12:06:32.852086 --- ParallelTerminationStrategy: PID 5994 died... 12:06:32.870570 run iperf3-srv_10.42.42.10(pid=5994): Terminated {rc=256} 12:06:32.914211 --- ParallelTerminationStrategy: PID 5997 died... 12:06:32.932769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5997): Terminated: ok {rc=0} 12:06:32.976186 --- ParallelTerminationStrategy: PID 6000 died... 12:06:32.994928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6000): Terminated: ok {rc=0} 12:06:33.039893 --- ParallelTerminationStrategy: PID 6003 died... 12:06:33.058482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6003): Terminated: ok {rc=0} 12:06:33.144092 bus /gobi_0: Setting Powered False 12:06:34.244099 bus /gobi_0: Setting Powered False 12:06:35.359048 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:06:36.505955 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:36.517939 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:06:36.590616 tst iperf3.py: using LAC 28280 12:06:36.721276 tst iperf3.py: using RAC 230 12:06:36.849898 tst iperf3.py: using CellId 28280 12:06:36.967751 tst iperf3.py: using BVCI 28281 12:06:37.077301 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.088387 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.099933 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.113673 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.124712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.136073 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.147815 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.159033 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:37.170916 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:06:37.285904 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:06:37.489676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:37.790860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6007): Launched 12:06:38.053126 run iperf3-srv_10.42.42.10(pid=6008): Launched 12:06:38.165976 tst iperf3.py:8: start network... 12:06:38.367241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:38.834708 run create_hlr_db(pid=6009): Launched 12:06:38.958468 bus /gobi_6: Setting Powered False 12:06:40.019213 run create_hlr_db(pid=6009): Terminated: ok {rc=0} 12:06:40.460552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6011): Launched 12:06:40.784428 run osmo-hlr_10.42.42.2(pid=6012): Launched 12:06:40.907768 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:41.467291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6014): Launched 12:06:41.790200 run osmo-stp_10.42.42.5(pid=6015): Launched 12:06:41.913649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:42.472752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6017): Launched 12:06:42.596480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:42.869656 run patchelf(pid=6018): Launched 12:06:43.049889 run osmo-stp_10.42.42.5(pid=6015): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6015)] 12:06:43.187400 run osmo-stp_10.42.42.5(pid=6015): stdout: | (launched: 2022-12-10_12:06:41.731412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:43.326248 run osmo-stp_10.42.42.5(pid=6015): stderr: | 20221210120641922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120641922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120641923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120641923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120641923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120641924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120641924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:43.465212 run osmo-stp_10.42.42.5(pid=6015): stdout: | (launched: 2022-12-10_12:06:41.731412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:43.597667 run osmo-stp_10.42.42.5(pid=6015): stderr: | 20221210120641922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120641922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120641923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120641923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120641923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120641924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120641924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:43.754458 run patchelf(pid=6018): Terminating (SIGINT) 12:06:43.935897 run patchelf(pid=6018): Terminated: ok {rc=0} 12:06:44.065922 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6015): Process ended prematurely: osmo-stp_10.42.42.5(pid=6015) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6015)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 12:06:44.075964 tst iperf3.py:8: Test FAILED (7.6 sec) 12:06:44.105199 run osmo-hlr_10.42.42.2(pid=6012): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6012)] 12:06:44.156314 run osmo-hlr_10.42.42.2(pid=6012): stdout: | (launched: 2022-12-10_12:06:40.725735) 12:06:44.208267 run osmo-hlr_10.42.42.2(pid=6012): stderr: | 20221210120640923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120640923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120640923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120640924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120640924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120640924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120640936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120640945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120640945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120640945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:44.260429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6007): Terminating (SIGTERM) 12:06:44.302497 run iperf3-srv_10.42.42.10(pid=6008): Terminating (SIGTERM) 12:06:44.344515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6011): Terminating (SIGTERM) 12:06:44.386224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6014): Terminating (SIGTERM) 12:06:44.427969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6017): Terminating (SIGTERM) 12:06:44.470524 --- ParallelTerminationStrategy: PID 6007 died... 12:06:44.490538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6007): Terminated: ok {rc=0} 12:06:44.537344 --- ParallelTerminationStrategy: PID 6008 died... 12:06:44.556782 run iperf3-srv_10.42.42.10(pid=6008): Terminated {rc=256} 12:06:44.603145 --- ParallelTerminationStrategy: PID 6011 died... 12:06:44.622745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6011): Terminated: ok {rc=0} 12:06:44.669316 --- ParallelTerminationStrategy: PID 6014 died... 12:06:44.688888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6014): Terminated: ok {rc=0} 12:06:44.735390 --- ParallelTerminationStrategy: PID 6017 died... 12:06:44.755030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6017): Terminated: ok {rc=0} 12:06:44.843211 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:06:46.006193 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.018197 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:06:46.088635 tst iperf3m4.py: using LAC 28281 12:06:46.246829 tst iperf3m4.py: using RAC 231 12:06:46.377549 tst iperf3m4.py: using CellId 28281 12:06:46.506619 tst iperf3m4.py: using BVCI 28282 12:06:46.626214 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.638174 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.650202 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.664677 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.676718 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.690655 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.703826 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.715915 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:06:46.728758 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:06:46.871445 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:06:47.006765 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:06:47.136639 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:06:47.272763 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:06:47.491940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:47.815292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6019): Launched 12:06:48.096091 run iperf3-srv_10.42.42.10(pid=6020): Launched 12:06:48.218297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:06:48.435925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:48.759982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6021): Launched 12:06:49.041951 run iperf3-srv_10.42.42.10(pid=6022): Launched 12:06:49.163565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:06:49.381778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:49.705693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6023): Launched 12:06:49.986636 run iperf3-srv_10.42.42.10(pid=6024): Launched 12:06:50.108071 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:06:50.326292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:50.649331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6025): Launched 12:06:50.929710 run iperf3-srv_10.42.42.10(pid=6026): Launched 12:06:51.050677 tst iperf3m4.py:8: start network... 12:06:51.268417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:51.766063 run create_hlr_db(pid=6027): Launched 12:06:51.888804 bus /gobi_6: Setting Powered False 12:06:52.952800 run create_hlr_db(pid=6027): Terminated: ok {rc=0} 12:06:53.384703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6029): Launched 12:06:53.686582 run osmo-hlr_10.42.42.2(pid=6030): Launched 12:06:53.801102 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:54.320698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6032): Launched 12:06:54.621767 run osmo-stp_10.42.42.5(pid=6033): Launched 12:06:54.736942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:55.255473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6035): Launched 12:06:55.371156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:55.625481 run patchelf(pid=6036): Launched 12:06:55.793598 run osmo-stp_10.42.42.5(pid=6033): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6033)] 12:06:55.920677 run osmo-stp_10.42.42.5(pid=6033): stdout: | (launched: 2022-12-10_12:06:54.566088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:56.049912 run osmo-stp_10.42.42.5(pid=6033): stderr: | 20221210120654739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120654739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120654739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120654740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120654740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120654740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120654741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:56.179056 run osmo-stp_10.42.42.5(pid=6033): stdout: | (launched: 2022-12-10_12:06:54.566088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:56.302644 run osmo-stp_10.42.42.5(pid=6033): stderr: | 20221210120654739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120654739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120654739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120654740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120654740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120654740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120654741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:56.448533 run patchelf(pid=6036): Terminating (SIGINT) 12:06:56.618477 run patchelf(pid=6036): Terminated: ok {rc=0} 12:06:56.740231 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6033): Process ended prematurely: osmo-stp_10.42.42.5(pid=6033) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6033)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:06:56.749664 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:06:56.777096 run osmo-hlr_10.42.42.2(pid=6030): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6030)] 12:06:56.824905 run osmo-hlr_10.42.42.2(pid=6030): stdout: | (launched: 2022-12-10_12:06:53.631162) 12:06:56.874228 run osmo-hlr_10.42.42.2(pid=6030): stderr: | 20221210120653807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120653807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120653807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120653808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120653808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120653808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120653820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120653829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120653829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120653829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:56.923992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6019): Terminating (SIGTERM) 12:06:56.964248 run iperf3-srv_10.42.42.10(pid=6020): Terminating (SIGTERM) 12:06:57.003859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6021): Terminating (SIGTERM) 12:06:57.043359 run iperf3-srv_10.42.42.10(pid=6022): Terminating (SIGTERM) 12:06:57.082758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6023): Terminating (SIGTERM) 12:06:57.122394 run iperf3-srv_10.42.42.10(pid=6024): Terminating (SIGTERM) 12:06:57.162256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6025): Terminating (SIGTERM) 12:06:57.201689 run iperf3-srv_10.42.42.10(pid=6026): Terminating (SIGTERM) 12:06:57.241047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6029): Terminating (SIGTERM) 12:06:57.280241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6032): Terminating (SIGTERM) 12:06:57.319457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6035): Terminating (SIGTERM) 12:06:57.359668 --- ParallelTerminationStrategy: PID 6019 died... 12:06:57.378803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6019): Terminated: ok {rc=0} 12:06:57.423344 --- ParallelTerminationStrategy: PID 6020 died... 12:06:57.441953 run iperf3-srv_10.42.42.10(pid=6020): Terminated {rc=256} 12:06:57.485487 --- ParallelTerminationStrategy: PID 6021 died... 12:06:57.503911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6021): Terminated: ok {rc=0} 12:06:57.547696 --- ParallelTerminationStrategy: PID 6022 died... 12:06:57.566278 run iperf3-srv_10.42.42.10(pid=6022): Terminated {rc=256} 12:06:57.610060 --- ParallelTerminationStrategy: PID 6023 died... 12:06:57.628470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6023): Terminated: ok {rc=0} 12:06:57.672368 --- ParallelTerminationStrategy: PID 6024 died... 12:06:57.691047 run iperf3-srv_10.42.42.10(pid=6024): Terminated {rc=256} 12:06:57.734723 --- ParallelTerminationStrategy: PID 6025 died... 12:06:57.753431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6025): Terminated: ok {rc=0} 12:06:57.797268 --- ParallelTerminationStrategy: PID 6026 died... 12:06:57.815828 run iperf3-srv_10.42.42.10(pid=6026): Terminated {rc=256} 12:06:57.859469 --- ParallelTerminationStrategy: PID 6029 died... 12:06:57.878097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6029): Terminated: ok {rc=0} 12:06:57.922086 --- ParallelTerminationStrategy: PID 6032 died... 12:06:57.940717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6032): Terminated: ok {rc=0} 12:06:57.984832 --- ParallelTerminationStrategy: PID 6035 died... 12:06:58.003767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6035): Terminated: ok {rc=0} 12:06:58.089390 bus /gobi_4: Setting Powered False 12:06:59.188171 bus /gobi_4: Setting Powered False 12:07:00.301754 bus /gobi_1: Setting Powered False 12:07:01.406739 bus /gobi_1: Setting Powered False 12:07:02.533612 bus /gobi_0: Setting Powered False 12:07:03.632668 bus /gobi_0: Setting Powered False 12:07:04.748202 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:07:05.851538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:05.862909 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:07:05.932412 tst ping.py: using LAC 28282 12:07:06.060440 tst ping.py: using RAC 232 12:07:06.188444 tst ping.py: using CellId 28282 12:07:06.311923 tst ping.py: using BVCI 28283 12:07:06.426450 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:06.437975 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:06.448904 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:06.460249 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:06.471474 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:06.482749 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:06.494341 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:06.505715 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:06.619425 tst ping.py:19: start network... 12:07:06.819501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:07.281517 run create_hlr_db(pid=6037): Launched 12:07:07.403737 bus /gobi_6: Setting Powered False 12:07:08.464158 run create_hlr_db(pid=6037): Terminated: ok {rc=0} 12:07:08.898309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Launched 12:07:09.218041 run osmo-hlr_10.42.42.2(pid=6040): Launched 12:07:09.340447 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:09.892536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Launched 12:07:10.210457 run osmo-stp_10.42.42.5(pid=6043): Launched 12:07:10.332635 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:10.881667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Launched 12:07:11.003386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:11.272874 run patchelf(pid=6047): Launched 12:07:11.449943 run osmo-stp_10.42.42.5(pid=6043): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] 12:07:11.584480 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-10_12:07:10.151880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:11.720262 run osmo-stp_10.42.42.5(pid=6043): stderr: | 20221210120710346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120710346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120710346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120710346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120710347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120710347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120710347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:11.856355 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-10_12:07:10.151880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:11.986678 run osmo-stp_10.42.42.5(pid=6043): stderr: | 20221210120710346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120710346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120710346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120710346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120710347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120710347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120710347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:12.141047 run patchelf(pid=6047): Terminating (SIGINT) 12:07:12.319244 run patchelf(pid=6047): Terminated: ok {rc=0} 12:07:12.447313 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 12:07:12.456804 tst ping.py:22: Test FAILED (6.6 sec) 12:07:12.485681 run osmo-hlr_10.42.42.2(pid=6040): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6040)] 12:07:12.536269 run osmo-hlr_10.42.42.2(pid=6040): stdout: | (launched: 2022-12-10_12:07:09.159765) 12:07:12.588452 run osmo-hlr_10.42.42.2(pid=6040): stderr: | 20221210120709357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120709357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120709357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120709357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120709357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120709357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120709369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120709377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120709377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120709377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:12.641287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminating (SIGTERM) 12:07:12.683315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminating (SIGTERM) 12:07:12.725375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminating (SIGTERM) 12:07:12.767794 --- ParallelTerminationStrategy: PID 6039 died... 12:07:12.788014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminated: ok {rc=0} 12:07:12.835029 --- ParallelTerminationStrategy: PID 6042 died... 12:07:12.854765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminated: ok {rc=0} 12:07:12.901468 --- ParallelTerminationStrategy: PID 6045 died... 12:07:12.920811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminated: ok {rc=0} 12:07:13.009214 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:07:14.097710 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.109597 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:07:14.180031 tst ping_idle_ping.py: using LAC 28283 12:07:14.298559 tst ping_idle_ping.py: using RAC 233 12:07:14.415885 tst ping_idle_ping.py: using CellId 28283 12:07:14.532602 tst ping_idle_ping.py: using BVCI 28284 12:07:14.639928 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.650736 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.661279 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.671922 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.682406 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.693030 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.703648 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:14.714268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:14.827222 tst ping_idle_ping.py:24: start network... 12:07:15.026099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:15.491382 run create_hlr_db(pid=6048): Launched 12:07:15.613888 bus /gobi_6: Setting Powered False 12:07:16.677083 run create_hlr_db(pid=6048): Terminated: ok {rc=0} 12:07:17.132165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6050): Launched 12:07:17.454848 run osmo-hlr_10.42.42.2(pid=6051): Launched 12:07:17.579216 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:18.131130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6053): Launched 12:07:18.450070 run osmo-stp_10.42.42.5(pid=6054): Launched 12:07:18.572010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:19.121294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6056): Launched 12:07:19.243813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:19.512631 run patchelf(pid=6057): Launched 12:07:19.689503 run osmo-stp_10.42.42.5(pid=6054): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6054)] 12:07:19.823880 run osmo-stp_10.42.42.5(pid=6054): stdout: | (launched: 2022-12-10_12:07:18.391634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:19.959959 run osmo-stp_10.42.42.5(pid=6054): stderr: | 20221210120718583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120718583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120718583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120718584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120718586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120718586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120718586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:20.095704 run osmo-stp_10.42.42.5(pid=6054): stdout: | (launched: 2022-12-10_12:07:18.391634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:20.226579 run osmo-stp_10.42.42.5(pid=6054): stderr: | 20221210120718583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120718583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120718583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120718584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120718586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120718586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120718586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:20.380754 run patchelf(pid=6057): Terminating (SIGINT) 12:07:20.558525 run patchelf(pid=6057): Terminated: ok {rc=0} 12:07:20.686393 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6054): Process ended prematurely: osmo-stp_10.42.42.5(pid=6054) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6054)] [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:07:20.695895 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:07:20.725057 run osmo-hlr_10.42.42.2(pid=6051): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6051)] 12:07:20.775450 run osmo-hlr_10.42.42.2(pid=6051): stdout: | (launched: 2022-12-10_12:07:17.396474) 12:07:20.827876 run osmo-hlr_10.42.42.2(pid=6051): stderr: | 20221210120717595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120717595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120717595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120717595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120717596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120717596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120717607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120717615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120717616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120717616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:20.880744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6050): Terminating (SIGTERM) 12:07:20.922967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6053): Terminating (SIGTERM) 12:07:20.965366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6056): Terminating (SIGTERM) 12:07:21.007995 --- ParallelTerminationStrategy: PID 6050 died... 12:07:21.028094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6050): Terminated: ok {rc=0} 12:07:21.075215 --- ParallelTerminationStrategy: PID 6053 died... 12:07:21.094937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6053): Terminated: ok {rc=0} 12:07:21.141720 --- ParallelTerminationStrategy: PID 6056 died... 12:07:21.161512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6056): Terminated: ok {rc=0} 12:07:21.250670 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:07:22.556832 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:07:22.564402 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:07:22.599049 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:07:22.634396 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:07:22.690984 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:07:22.725415 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:07:22.759580 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:07:23.314253 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:07:23.320465 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.332512 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:07:23.404509 tst switch_tch_pdch.py: using LAC 28284 12:07:23.523086 tst switch_tch_pdch.py: using RAC 234 12:07:23.640280 tst switch_tch_pdch.py: using CellId 28284 12:07:23.766276 tst switch_tch_pdch.py: using BVCI 28285 12:07:23.881233 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.892738 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.904088 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.915667 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.927871 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.939629 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.951311 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:07:23.962875 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:07:24.078652 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:07:24.198154 tst switch_tch_pdch.py:51: start network... 12:07:24.397199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:24.856918 run create_hlr_db(pid=6062): Launched 12:07:24.979406 bus /gobi_6: Setting Powered False 12:07:26.039095 run create_hlr_db(pid=6062): Terminated: ok {rc=0} 12:07:26.474899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6064): Launched 12:07:26.792482 run osmo-hlr_10.42.42.2(pid=6065): Launched 12:07:26.914163 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:27.459290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6067): Launched 12:07:27.776365 run osmo-stp_10.42.42.5(pid=6068): Launched 12:07:27.898201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:28.446415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6070): Launched 12:07:28.567855 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:28.835588 run patchelf(pid=6071): Launched 12:07:29.012021 run osmo-stp_10.42.42.5(pid=6068): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6068)] 12:07:29.145953 run osmo-stp_10.42.42.5(pid=6068): stdout: | (launched: 2022-12-10_12:07:27.718430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:29.282460 run osmo-stp_10.42.42.5(pid=6068): stderr: | 20221210120727911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120727911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120727911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120727912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120727912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120727912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120727912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:29.418440 run osmo-stp_10.42.42.5(pid=6068): stdout: | (launched: 2022-12-10_12:07:27.718430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:29.548439 run osmo-stp_10.42.42.5(pid=6068): stderr: | 20221210120727911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120727911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120727911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120727912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120727912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120727912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120727912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:29.702567 run patchelf(pid=6071): Terminating (SIGINT) 12:07:29.879917 run patchelf(pid=6071): Terminated: ok {rc=0} 12:07:30.007983 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6068): Process ended prematurely: osmo-stp_10.42.42.5(pid=6068) [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6068)] [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:07:30.017716 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:07:30.046327 run osmo-hlr_10.42.42.2(pid=6065): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6065)] 12:07:30.096603 run osmo-hlr_10.42.42.2(pid=6065): stdout: | (launched: 2022-12-10_12:07:26.734422) 12:07:30.148594 run osmo-hlr_10.42.42.2(pid=6065): stderr: | 20221210120726930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120726930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120726930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120726930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120726930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120726930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120726942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120726952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120726953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120726953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:30.201329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6064): Terminating (SIGTERM) 12:07:30.243352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6067): Terminating (SIGTERM) 12:07:30.285621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6070): Terminating (SIGTERM) 12:07:30.327898 --- ParallelTerminationStrategy: PID 6064 died... 12:07:30.347896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6064): Terminated: ok {rc=0} 12:07:30.394619 --- ParallelTerminationStrategy: PID 6067 died... 12:07:30.414112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6067): Terminated: ok {rc=0} 12:07:30.460539 --- ParallelTerminationStrategy: PID 6070 died... 12:07:30.480081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6070): Terminated: ok {rc=0} 12:07:30.567443 bus /gobi_0: Setting Powered False 12:07:31.666067 bus /gobi_0: Setting Powered False 12:07:32.780127 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:07:34.033825 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:07:34.039982 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:07:34.076005 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:07:34.111723 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:07:34.166188 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:07:34.200656 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:07:34.236626 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:07:34.789381 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:07:34.794575 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:34.805857 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:07:34.878216 tst switch_tch_pdch.py: using LAC 28285 12:07:35.002817 tst switch_tch_pdch.py: using RAC 235 12:07:35.126402 tst switch_tch_pdch.py: using CellId 28285 12:07:35.252562 tst switch_tch_pdch.py: using BVCI 28286 12:07:35.367788 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:35.379103 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:35.390252 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:35.402209 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:35.414025 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:35.425690 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:35.437469 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:07:35.449199 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:07:35.565293 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:07:35.685297 tst switch_tch_pdch.py:51: start network... 12:07:35.899124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:36.367679 run create_hlr_db(pid=6076): Launched 12:07:36.489180 bus /gobi_6: Setting Powered False 12:07:37.552030 run create_hlr_db(pid=6076): Terminated: ok {rc=0} 12:07:37.966127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6078): Launched 12:07:38.283595 run osmo-hlr_10.42.42.2(pid=6079): Launched 12:07:38.405408 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:38.920649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6081): Launched 12:07:39.237181 run osmo-stp_10.42.42.5(pid=6082): Launched 12:07:39.359135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:39.876656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6084): Launched 12:07:39.997627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:40.264569 run patchelf(pid=6085): Launched 12:07:40.439869 run osmo-stp_10.42.42.5(pid=6082): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6082)] 12:07:40.573244 run osmo-stp_10.42.42.5(pid=6082): stdout: | (launched: 2022-12-10_12:07:39.179143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:40.708036 run osmo-stp_10.42.42.5(pid=6082): stderr: | 20221210120739374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120739374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120739374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120739374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120739375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120739375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120739375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:40.842929 run osmo-stp_10.42.42.5(pid=6082): stdout: | (launched: 2022-12-10_12:07:39.179143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:40.971932 run osmo-stp_10.42.42.5(pid=6082): stderr: | 20221210120739374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120739374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120739374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120739374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120739375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120739375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120739375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:41.125361 run patchelf(pid=6085): Terminating (SIGINT) 12:07:41.303264 run patchelf(pid=6085): Terminated: ok {rc=0} 12:07:41.431596 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6082): Process ended prematurely: osmo-stp_10.42.42.5(pid=6082) [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6082)] [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:07:41.441067 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 12:07:41.469492 run osmo-hlr_10.42.42.2(pid=6079): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6079)] 12:07:41.519668 run osmo-hlr_10.42.42.2(pid=6079): stdout: | (launched: 2022-12-10_12:07:38.225680) 12:07:41.571513 run osmo-hlr_10.42.42.2(pid=6079): stderr: | 20221210120738422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120738422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120738422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120738422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120738422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120738423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120738438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120738447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120738447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120738447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:41.623396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6078): Terminating (SIGTERM) 12:07:41.664990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6081): Terminating (SIGTERM) 12:07:41.706516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6084): Terminating (SIGTERM) 12:07:41.748211 --- ParallelTerminationStrategy: PID 6078 died... 12:07:41.768104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6078): Terminated: ok {rc=0} 12:07:41.814510 --- ParallelTerminationStrategy: PID 6081 died... 12:07:41.833917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6081): Terminated: ok {rc=0} 12:07:41.880404 --- ParallelTerminationStrategy: PID 6084 died... 12:07:41.900180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6084): Terminated: ok {rc=0} 12:07:41.988201 bus /gobi_0: Setting Powered False 12:07:43.086376 bus /gobi_0: Setting Powered False 12:07:44.206487 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:07:45.456748 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:07:45.460867 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:07:45.491497 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:07:45.498466 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:07:45.550895 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:07:45.580505 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:07:45.587437 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:07:46.145849 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:07:46.154688 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:07:46.170013 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:07:46.223209 tst mo_mt_sms.py: using LAC 28286 12:07:46.346137 tst mo_mt_sms.py: using RAC 236 12:07:46.491814 tst mo_mt_sms.py: using CellId 28286 12:07:46.645402 tst mo_mt_sms.py: using BVCI 28287 12:07:46.793835 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:07:46.913845 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:07:47.052270 tst mo_mt_sms.py:9: start nitb and bts... 12:07:47.296350 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:07:47.902608 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6089): Launched 12:07:48.199377 run osmo-nitb_10.42.42.2(pid=6090): Launched 12:07:48.364583 run osmo-nitb_10.42.42.2(pid=6090): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6090)] 12:07:48.497305 run osmo-nitb_10.42.42.2(pid=6090): stdout: | (launched: 2022-12-10_12:07:48.144812) 12:07:48.631719 run osmo-nitb_10.42.42.2(pid=6090): stderr: | (launched: 2022-12-10_12:07:48.189081) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:07:48.765777 run osmo-nitb_10.42.42.2(pid=6090): stdout: | (launched: 2022-12-10_12:07:48.144812) 12:07:48.894313 run osmo-nitb_10.42.42.2(pid=6090): stderr: | (launched: 2022-12-10_12:07:48.189081) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6090) [trial-2374↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6090)] 12:07:49.312071 tst osmo-nitb_10.42.42.2(pid=6090): stdout: | (launched: 2022-12-10_12:07:48.144812) 12:07:49.432552 tst osmo-nitb_10.42.42.2(pid=6090): stderr: | (launched: 2022-12-10_12:07:48.189081) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:07:49.573557 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6090) [trial-2374↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6090)] [trial-2374↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 12:07:49.581878 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 12:07:49.588327 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6089): Terminating (SIGTERM) 12:07:49.796321 --- ParallelTerminationStrategy: PID 6089 died... 12:07:49.816588 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6089): Terminated: ok {rc=0} 12:07:49.902923 bus /sierra_3: Setting Powered False 12:07:51.004064 bus /sierra_3: Setting Powered False 12:07:52.123351 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:07:53.311931 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:07:53.315684 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:07:53.344153 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:07:53.370277 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:07:53.422447 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:07:53.451365 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:07:53.477218 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:07:54.023645 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:07:54.028453 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:07:54.039171 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:07:54.081955 tst mo_mt_sms.py: using LAC 28287 12:07:54.198565 tst mo_mt_sms.py: using RAC 237 12:07:54.315557 tst mo_mt_sms.py: using CellId 28287 12:07:54.431444 tst mo_mt_sms.py: using BVCI 28288 12:07:54.539792 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:07:54.550532 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:07:54.561001 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:07:54.571475 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:07:54.581911 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:07:54.592258 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:07:54.708927 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:07:54.823037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:55.283019 run create_hlr_db(pid=6095): Launched 12:07:55.404545 bus /sierra_2: Setting Powered False 12:07:56.464251 run create_hlr_db(pid=6095): Terminated: ok {rc=0} 12:07:56.897862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6097): Launched 12:07:57.215162 run osmo-hlr_10.42.42.2(pid=6098): Launched 12:07:57.336638 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:57.884632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6100): Launched 12:07:58.202745 run osmo-stp_10.42.42.5(pid=6101): Launched 12:07:58.324344 run osmo-msc_10.42.42.6: Starting osmo-msc 12:07:58.900308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6103): Launched 12:07:59.218615 run osmo-msc_10.42.42.6(pid=6104): Launched 12:07:59.397271 run osmo-stp_10.42.42.5(pid=6101): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6101)] 12:07:59.531415 run osmo-stp_10.42.42.5(pid=6101): stdout: | (launched: 2022-12-10_12:07:58.144372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:59.665202 run osmo-stp_10.42.42.5(pid=6101): stderr: | 20221210120758336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120758336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120758336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120758337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120758337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120758337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120758338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:59.798613 run osmo-stp_10.42.42.5(pid=6101): stdout: | (launched: 2022-12-10_12:07:58.144372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:59.925380 run osmo-stp_10.42.42.5(pid=6101): stderr: | 20221210120758336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120758336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120758336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120758337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120758337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120758337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120758338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:00.077297 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6101): Process ended prematurely: osmo-stp_10.42.42.5(pid=6101) [trial-2374↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6101)] [trial-2374↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 12:08:00.086329 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 12:08:00.114303 run osmo-hlr_10.42.42.2(pid=6098): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6098)] 12:08:00.164119 run osmo-hlr_10.42.42.2(pid=6098): stdout: | (launched: 2022-12-10_12:07:57.156819) 12:08:00.216391 run osmo-hlr_10.42.42.2(pid=6098): stderr: | 20221210120757356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120757356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120757356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120757356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120757356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120757356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120757368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120757378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120757378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120757378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:00.288664 run osmo-msc_10.42.42.6(pid=6104): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6104)] 12:08:00.338826 run osmo-msc_10.42.42.6(pid=6104): stdout: | (launched: 2022-12-10_12:07:59.160438) 12:08:00.390498 run osmo-msc_10.42.42.6(pid=6104): stderr: | 20221210120759484 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120759484 DLGLOBAL DEBUG validating counter group 0x7ff619e82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120759485 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120759485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120759485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120759485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120759487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120759487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120759487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120759487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:08:00.442558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6097): Terminating (SIGTERM) 12:08:00.484008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6100): Terminating (SIGTERM) 12:08:00.525699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6103): Terminating (SIGTERM) 12:08:00.567903 --- ParallelTerminationStrategy: PID 6097 died... 12:08:00.588033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6097): Terminated: ok {rc=0} 12:08:00.634809 --- ParallelTerminationStrategy: PID 6100 died... 12:08:00.654395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6100): Terminated: ok {rc=0} 12:08:00.701051 --- ParallelTerminationStrategy: PID 6103 died... 12:08:00.720633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6103): Terminated: ok {rc=0} 12:08:00.809018 bus /sierra_3: Setting Powered False 12:08:01.923370 bus /sierra_3: Setting Powered False 12:08:03.048880 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:08:04.276582 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:04.280848 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:08:04.312000 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:08:04.319007 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:08:04.357109 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:08:04.386094 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:08:04.392838 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:08:04.908032 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:08:04.913246 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:08:04.924007 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:08:04.975950 tst assert_extension.py: using LAC 28288 12:08:05.092651 tst assert_extension.py: using RAC 238 12:08:05.207427 tst assert_extension.py: using CellId 28288 12:08:05.322037 tst assert_extension.py: using BVCI 28289 12:08:05.428427 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:08:05.543421 tst assert_extension.py:10: start nitb and bts... 12:08:05.757809 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:08:06.408472 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6109): Launched 12:08:06.726146 run osmo-nitb_10.42.42.2(pid=6110): Launched 12:08:06.902521 run osmo-nitb_10.42.42.2(pid=6110): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6110)] 12:08:07.044726 run osmo-nitb_10.42.42.2(pid=6110): stdout: | (launched: 2022-12-10_12:08:06.668275) 12:08:07.188483 run osmo-nitb_10.42.42.2(pid=6110): stderr: | (launched: 2022-12-10_12:08:06.715346) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:08:07.332184 run osmo-nitb_10.42.42.2(pid=6110): stdout: | (launched: 2022-12-10_12:08:06.668275) 12:08:07.470429 run osmo-nitb_10.42.42.2(pid=6110): stderr: | (launched: 2022-12-10_12:08:06.715346) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6110): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6110) [trial-2374↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6110)] 12:08:07.846150 tst osmo-nitb_10.42.42.2(pid=6110): stdout: | (launched: 2022-12-10_12:08:06.668275) 12:08:07.974909 tst osmo-nitb_10.42.42.2(pid=6110): stderr: | (launched: 2022-12-10_12:08:06.715346) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:08:08.126183 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6110): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6110) [trial-2374↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6110)] [trial-2374↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 12:08:08.135154 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:08:08.142357 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6109): Terminating (SIGTERM) 12:08:08.353110 --- ParallelTerminationStrategy: PID 6109 died... 12:08:08.374173 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6109): Terminated: ok {rc=0} 12:08:08.462510 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:08:09.635454 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:09.640116 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:08:09.670949 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:08:09.698302 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:08:09.735214 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:08:09.764511 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:08:09.790747 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:08:10.320467 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:08:10.326716 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:08:10.338428 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:08:10.383185 tst assert_extension.py: using LAC 28289 12:08:10.511386 tst assert_extension.py: using RAC 239 12:08:10.634140 tst assert_extension.py: using CellId 28289 12:08:10.756051 tst assert_extension.py: using BVCI 28290 12:08:10.870307 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:08:10.881499 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:08:10.892464 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:08:10.903828 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:08:10.915086 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:08:10.926191 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:08:11.039633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:11.498994 run create_hlr_db(pid=6114): Launched 12:08:11.621954 bus /sierra_2: Setting Powered False 12:08:12.681618 run create_hlr_db(pid=6114): Terminated: ok {rc=0} 12:08:13.115215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6116): Launched 12:08:13.435147 run osmo-hlr_10.42.42.2(pid=6117): Launched 12:08:13.558886 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:14.110687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6119): Launched 12:08:14.429051 run osmo-stp_10.42.42.5(pid=6120): Launched 12:08:14.552885 run osmo-msc_10.42.42.6: Starting osmo-msc 12:08:15.127036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6122): Launched 12:08:15.445595 run osmo-msc_10.42.42.6(pid=6123): Launched 12:08:15.627095 run osmo-stp_10.42.42.5(pid=6120): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6120)] 12:08:15.761904 run osmo-stp_10.42.42.5(pid=6120): stdout: | (launched: 2022-12-10_12:08:14.371021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:15.956307 run osmo-stp_10.42.42.5(pid=6120): stderr: | 20221210120814562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120814562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120814563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120814563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120814563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120814564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120814564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:16.129314 run osmo-stp_10.42.42.5(pid=6120): stdout: | (launched: 2022-12-10_12:08:14.371021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:16.259782 run osmo-stp_10.42.42.5(pid=6120): stderr: | 20221210120814562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120814562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120814563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120814563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120814563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120814564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120814564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:16.415219 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6120): Process ended prematurely: osmo-stp_10.42.42.5(pid=6120) [trial-2374↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6120)] [trial-2374↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 12:08:16.425051 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:08:16.455866 run osmo-hlr_10.42.42.2(pid=6117): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6117)] 12:08:16.517831 run osmo-hlr_10.42.42.2(pid=6117): stdout: | (launched: 2022-12-10_12:08:13.376937) 12:08:16.582990 run osmo-hlr_10.42.42.2(pid=6117): stderr: | 20221210120813576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120813576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120813576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120813576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120813576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120813576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120813588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120813596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120813597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120813597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:16.675360 run osmo-msc_10.42.42.6(pid=6123): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6123)] 12:08:16.732101 run osmo-msc_10.42.42.6(pid=6123): stdout: | (launched: 2022-12-10_12:08:15.387724) 12:08:16.792641 run osmo-msc_10.42.42.6(pid=6123): stderr: | 20221210120815708 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120815708 DLGLOBAL DEBUG validating counter group 0x7f6fec890c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120815708 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120815708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120815708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120815708 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120815710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120815711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120815711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120815711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:08:16.856128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6116): Terminating (SIGTERM) 12:08:16.907116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6119): Terminating (SIGTERM) 12:08:16.956829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6122): Terminating (SIGTERM) 12:08:17.003173 --- ParallelTerminationStrategy: PID 6116 died... 12:08:17.028230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6116): Terminated: ok {rc=0} 12:08:17.086070 --- ParallelTerminationStrategy: PID 6119 died... 12:08:17.106705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6119): Terminated: ok {rc=0} 12:08:17.156247 --- ParallelTerminationStrategy: PID 6122 died... 12:08:17.177021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6122): Terminated: ok {rc=0} 12:08:17.277632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:08:18.526628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:18.539339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:08:18.572269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:08:18.603872 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:08:18.686456 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:08:18.746676 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:08:18.788398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:08:19.283583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:08:19.341787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:19.354500 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:08:19.423498 tst mo_mt_call.py: using LAC 28290 12:08:19.555285 tst mo_mt_call.py: using RAC 240 12:08:19.685739 tst mo_mt_call.py: using CellId 28290 12:08:19.816133 tst mo_mt_call.py: using BVCI 28291 12:08:19.937290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:19.950044 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:19.962445 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:19.976924 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:19.990789 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:20.004451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:08:20.130519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:08:20.254812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:20.772498 run create_hlr_db(pid=6400): Launched 12:08:20.933372 bus /sierra_2: Setting Powered False 12:08:21.996665 run create_hlr_db(pid=6400): Terminated: ok {rc=0} 12:08:22.468647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6403): Launched 12:08:22.817715 run osmo-hlr_10.42.42.2(pid=6404): Launched 12:08:23.049122 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:23.772264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6406): Launched 12:08:24.099804 run osmo-stp_10.42.42.5(pid=6407): Launched 12:08:24.337602 run osmo-msc_10.42.42.6: Starting osmo-msc 12:08:25.062034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6409): Launched 12:08:25.390233 run osmo-msc_10.42.42.6(pid=6410): Launched 12:08:25.741904 run osmo-stp_10.42.42.5(pid=6407): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6407)] 12:08:26.007564 run osmo-stp_10.42.42.5(pid=6407): stdout: | (launched: 2022-12-10_12:08:24.036390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:26.281238 run osmo-stp_10.42.42.5(pid=6407): stderr: | 20221210120824369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120824370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120824370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120824370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120824371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120824371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120824371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:26.455629 run osmo-stp_10.42.42.5(pid=6407): stdout: | (launched: 2022-12-10_12:08:24.036390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:26.579693 run osmo-stp_10.42.42.5(pid=6407): stderr: | 20221210120824369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120824370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120824370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120824370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120824371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120824371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120824371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:26.727994 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6407): Process ended prematurely: osmo-stp_10.42.42.5(pid=6407) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6407)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:08:26.738142 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 12:08:26.766615 run osmo-hlr_10.42.42.2(pid=6404): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6404)] 12:08:26.816404 run osmo-hlr_10.42.42.2(pid=6404): stdout: | (launched: 2022-12-10_12:08:22.751645) 12:08:26.867570 run osmo-hlr_10.42.42.2(pid=6404): stderr: | 20221210120823091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120823091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120823091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120823092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120823092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120823092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120823119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120823132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120823132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120823132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:26.939065 run osmo-msc_10.42.42.6(pid=6410): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6410)] 12:08:26.988498 run osmo-msc_10.42.42.6(pid=6410): stdout: | (launched: 2022-12-10_12:08:25.326980) 12:08:27.039498 run osmo-msc_10.42.42.6(pid=6410): stderr: | 20221210120825926 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120825926 DLGLOBAL DEBUG validating counter group 0x7fe85e784c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120825927 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120825927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120825927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120825927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120825929 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120825929 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120825929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120825929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:08:27.090976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6403): Terminating (SIGTERM) 12:08:27.132416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6406): Terminating (SIGTERM) 12:08:27.174723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6409): Terminating (SIGTERM) 12:08:27.218498 --- ParallelTerminationStrategy: PID 6403 died... 12:08:27.238283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6403): Terminated: ok {rc=0} 12:08:27.285307 --- ParallelTerminationStrategy: PID 6406 died... 12:08:27.304552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6406): Terminated: ok {rc=0} 12:08:27.349793 --- ParallelTerminationStrategy: PID 6409 died... 12:08:27.369150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6409): Terminated: ok {rc=0} 12:08:27.455059 bus /sierra_3: Setting Powered False 12:08:28.556858 bus /sierra_3: Setting Powered False 12:08:29.674048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:08:30.824054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:30.844700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:08:30.924444 tst mo_mt_call_osmux.py: using LAC 28291 12:08:31.071832 tst mo_mt_call_osmux.py: using RAC 241 12:08:31.232929 tst mo_mt_call_osmux.py: using CellId 28291 12:08:31.427853 tst mo_mt_call_osmux.py: using BVCI 28292 12:08:31.572166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:31.585770 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:31.598153 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:31.612798 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:31.626461 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:08:31.639009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:08:31.780533 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:08:31.935286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:32.558312 run create_hlr_db(pid=6412): Launched 12:08:32.733729 bus /sierra_2: Setting Powered False 12:08:33.793313 run create_hlr_db(pid=6412): Terminated: ok {rc=0} 12:08:34.247826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6414): Launched 12:08:34.585817 run osmo-hlr_10.42.42.2(pid=6415): Launched 12:08:34.816760 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:35.555119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6417): Launched 12:08:35.887032 run osmo-stp_10.42.42.5(pid=6418): Launched 12:08:36.137268 run osmo-msc_10.42.42.6: Starting osmo-msc 12:08:36.868730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6420): Launched 12:08:37.203936 run osmo-msc_10.42.42.6(pid=6421): Launched 12:08:37.563885 run osmo-stp_10.42.42.5(pid=6418): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6418)] 12:08:37.833636 run osmo-stp_10.42.42.5(pid=6418): stdout: | (launched: 2022-12-10_12:08:35.823608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:38.117532 run osmo-stp_10.42.42.5(pid=6418): stderr: | 20221210120836169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120836169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120836170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120836170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120836171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120836171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120836171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:38.291204 run osmo-stp_10.42.42.5(pid=6418): stdout: | (launched: 2022-12-10_12:08:35.823608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:38.417145 run osmo-stp_10.42.42.5(pid=6418): stderr: | 20221210120836169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120836169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120836170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120836170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120836171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120836171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120836171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:38.569013 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6418): Process ended prematurely: osmo-stp_10.42.42.5(pid=6418) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6418)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:08:38.579364 tst mo_mt_call_osmux.py:8: Test FAILED (7.8 sec) 12:08:38.608137 run osmo-hlr_10.42.42.2(pid=6415): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6415)] 12:08:38.658394 run osmo-hlr_10.42.42.2(pid=6415): stdout: | (launched: 2022-12-10_12:08:34.514958) 12:08:38.710498 run osmo-hlr_10.42.42.2(pid=6415): stderr: | 20221210120834869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120834869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120834869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120834869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120834869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120834870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120834888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120834902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120834903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120834903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:38.783284 run osmo-msc_10.42.42.6(pid=6421): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6421)] 12:08:38.833232 run osmo-msc_10.42.42.6(pid=6421): stdout: | (launched: 2022-12-10_12:08:37.136725) 12:08:38.883881 run osmo-msc_10.42.42.6(pid=6421): stderr: | 20221210120837741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120837741 DLGLOBAL DEBUG validating counter group 0x7ff71a491c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120837741 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120837742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120837742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120837742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120837745 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120837746 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120837746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120837746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:08:38.935502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6414): Terminating (SIGTERM) 12:08:38.978399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6417): Terminating (SIGTERM) 12:08:39.021930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6420): Terminating (SIGTERM) 12:08:39.066448 --- ParallelTerminationStrategy: PID 6414 died... 12:08:39.086258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6414): Terminated: ok {rc=0} 12:08:39.133729 --- ParallelTerminationStrategy: PID 6417 died... 12:08:39.154180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6417): Terminated: ok {rc=0} 12:08:39.200021 --- ParallelTerminationStrategy: PID 6420 died... 12:08:39.220509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6420): Terminated: ok {rc=0} 12:08:39.306815 bus /sierra_3: Setting Powered False 12:08:40.409838 bus /sierra_3: Setting Powered False 12:08:41.524529 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:08:42.772686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:42.779502 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:08:42.809940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:08:42.837242 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:08:42.891522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:08:42.921818 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:08:42.948877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:08:43.498894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:08:43.551434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:43.563220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:08:43.629974 tst mo_mt_call.py: using LAC 28292 12:08:43.749104 tst mo_mt_call.py: using RAC 242 12:08:43.878102 tst mo_mt_call.py: using CellId 28292 12:08:43.998678 tst mo_mt_call.py: using BVCI 28293 12:08:44.110011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:44.121293 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:44.132544 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:44.143732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:44.154842 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:44.165684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:08:44.285639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:08:44.406395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:44.906035 run create_hlr_db(pid=6426): Launched 12:08:45.029757 bus /sierra_2: Setting Powered False 12:08:46.093737 run create_hlr_db(pid=6426): Terminated: ok {rc=0} 12:08:46.560772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Launched 12:08:46.905928 run osmo-hlr_10.42.42.2(pid=6429): Launched 12:08:47.158165 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:47.730450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Launched 12:08:48.032825 run osmo-stp_10.42.42.5(pid=6432): Launched 12:08:48.148333 run osmo-msc_10.42.42.6: Starting osmo-msc 12:08:48.694295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6434): Launched 12:08:48.995874 run osmo-msc_10.42.42.6(pid=6435): Launched 12:08:49.164373 run osmo-stp_10.42.42.5(pid=6432): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] 12:08:49.291720 run osmo-stp_10.42.42.5(pid=6432): stdout: | (launched: 2022-12-10_12:08:47.977506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:49.418933 run osmo-stp_10.42.42.5(pid=6432): stderr: | 20221210120848148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120848149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120848149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120848150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120848150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120848150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120848150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:49.543960 run osmo-stp_10.42.42.5(pid=6432): stdout: | (launched: 2022-12-10_12:08:47.977506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:49.663868 run osmo-stp_10.42.42.5(pid=6432): stderr: | 20221210120848148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120848149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120848149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120848150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120848150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120848150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120848150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:49.807460 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6432): Process ended prematurely: osmo-stp_10.42.42.5(pid=6432) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:08:49.816227 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:08:49.842985 run osmo-hlr_10.42.42.2(pid=6429): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6429)] 12:08:49.890134 run osmo-hlr_10.42.42.2(pid=6429): stdout: | (launched: 2022-12-10_12:08:46.842093) 12:08:49.938718 run osmo-hlr_10.42.42.2(pid=6429): stderr: | 20221210120847155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120847155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120847155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120847155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120847155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120847155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120847175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120847192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120847192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120847192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:50.008368 run osmo-msc_10.42.42.6(pid=6435): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6435)] 12:08:50.055537 run osmo-msc_10.42.42.6(pid=6435): stdout: | (launched: 2022-12-10_12:08:48.940111) 12:08:50.104003 run osmo-msc_10.42.42.6(pid=6435): stderr: | 20221210120849211 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120849211 DLGLOBAL DEBUG validating counter group 0x7f97ed6cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120849212 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120849212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120849212 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120849212 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120849214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120849214 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120849214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120849215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:08:50.153062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Terminating (SIGTERM) 12:08:50.191943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Terminating (SIGTERM) 12:08:50.230959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6434): Terminating (SIGTERM) 12:08:50.270393 --- ParallelTerminationStrategy: PID 6428 died... 12:08:50.289281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Terminated: ok {rc=0} 12:08:50.332670 --- ParallelTerminationStrategy: PID 6431 died... 12:08:50.351158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Terminated: ok {rc=0} 12:08:50.394290 --- ParallelTerminationStrategy: PID 6434 died... 12:08:50.412758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6434): Terminated: ok {rc=0} 12:08:50.496034 bus /sierra_3: Setting Powered False 12:08:51.592871 bus /sierra_3: Setting Powered False 12:08:52.708202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:08:53.857744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:53.870329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:08:53.938523 tst mo_mt_call_osmux.py: using LAC 28293 12:08:54.066557 tst mo_mt_call_osmux.py: using RAC 243 12:08:54.194332 tst mo_mt_call_osmux.py: using CellId 28293 12:08:54.319860 tst mo_mt_call_osmux.py: using BVCI 28294 12:08:54.437419 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:54.449373 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:54.460759 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:54.472696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:54.484622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:08:54.496551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:08:54.611498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:08:54.729574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:55.233319 run create_hlr_db(pid=6437): Launched 12:08:55.357263 bus /sierra_2: Setting Powered False 12:08:56.421818 run create_hlr_db(pid=6437): Terminated: ok {rc=0} 12:08:56.873420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6439): Launched 12:08:57.198502 run osmo-hlr_10.42.42.2(pid=6440): Launched 12:08:57.323004 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:57.881142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6442): Launched 12:08:58.205994 run osmo-stp_10.42.42.5(pid=6443): Launched 12:08:58.330281 run osmo-msc_10.42.42.6: Starting osmo-msc 12:08:58.914352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6445): Launched 12:08:59.238977 run osmo-msc_10.42.42.6(pid=6446): Launched 12:08:59.419171 run osmo-stp_10.42.42.5(pid=6443): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6443)] 12:08:59.555570 run osmo-stp_10.42.42.5(pid=6443): stdout: | (launched: 2022-12-10_12:08:58.146853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:59.692397 run osmo-stp_10.42.42.5(pid=6443): stderr: | 20221210120858340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120858340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120858340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120858341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120858341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120858341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120858341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:59.828590 run osmo-stp_10.42.42.5(pid=6443): stdout: | (launched: 2022-12-10_12:08:58.146853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:59.958545 run osmo-stp_10.42.42.5(pid=6443): stderr: | 20221210120858340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120858340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120858340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120858341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120858341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120858341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120858341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:00.113095 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6443): Process ended prematurely: osmo-stp_10.42.42.5(pid=6443) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6443)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:09:00.122899 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:09:00.151469 run osmo-hlr_10.42.42.2(pid=6440): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6440)] 12:09:00.202055 run osmo-hlr_10.42.42.2(pid=6440): stdout: | (launched: 2022-12-10_12:08:57.139252) 12:09:00.254169 run osmo-hlr_10.42.42.2(pid=6440): stderr: | 20221210120857338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120857338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120857338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120857338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120857338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120857339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120857351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120857360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120857360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120857360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:00.326684 run osmo-msc_10.42.42.6(pid=6446): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6446)] 12:09:00.377141 run osmo-msc_10.42.42.6(pid=6446): stdout: | (launched: 2022-12-10_12:08:59.179285) 12:09:00.429089 run osmo-msc_10.42.42.6(pid=6446): stderr: | 20221210120859502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120859502 DLGLOBAL DEBUG validating counter group 0x7f702078ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120859502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120859502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120859503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120859503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120859504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120859505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120859505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120859505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:00.481304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6439): Terminating (SIGTERM) 12:09:00.523431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6442): Terminating (SIGTERM) 12:09:00.565345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6445): Terminating (SIGTERM) 12:09:00.607476 --- ParallelTerminationStrategy: PID 6439 died... 12:09:00.627218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6439): Terminated: ok {rc=0} 12:09:00.674252 --- ParallelTerminationStrategy: PID 6442 died... 12:09:00.693785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6442): Terminated: ok {rc=0} 12:09:00.740534 --- ParallelTerminationStrategy: PID 6445 died... 12:09:00.760303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6445): Terminated: ok {rc=0} 12:09:00.851437 bus /sierra_3: Setting Powered False 12:09:01.960161 bus /sierra_3: Setting Powered False 12:09:03.077667 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:09:04.328934 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:04.336056 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:09:04.367256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:09:04.395463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:09:04.449756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:09:04.481240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:09:04.508728 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:09:05.058795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:09:05.111644 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:05.123430 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:09:05.197455 tst mo_mt_call.py: using LAC 28294 12:09:05.315799 tst mo_mt_call.py: using RAC 244 12:09:05.432813 tst mo_mt_call.py: using CellId 28294 12:09:05.549293 tst mo_mt_call.py: using BVCI 28295 12:09:05.657942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:05.669332 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:05.680601 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:05.691556 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:05.702602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:05.713518 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:09:05.831985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:09:05.948494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:06.417057 run create_hlr_db(pid=6451): Launched 12:09:06.540712 bus /sierra_2: Setting Powered False 12:09:07.601583 run create_hlr_db(pid=6451): Terminated: ok {rc=0} 12:09:08.044445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6453): Launched 12:09:08.369838 run osmo-hlr_10.42.42.2(pid=6454): Launched 12:09:08.493537 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:09.050617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6456): Launched 12:09:09.375013 run osmo-stp_10.42.42.5(pid=6457): Launched 12:09:09.498647 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:10.087958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6459): Launched 12:09:10.413700 run osmo-msc_10.42.42.6(pid=6460): Launched 12:09:10.596404 run osmo-stp_10.42.42.5(pid=6457): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6457)] 12:09:10.733165 run osmo-stp_10.42.42.5(pid=6457): stdout: | (launched: 2022-12-10_12:09:09.315907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:10.870031 run osmo-stp_10.42.42.5(pid=6457): stderr: | 20221210120909509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120909509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120909509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120909510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120909510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120909510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120909510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:11.006070 run osmo-stp_10.42.42.5(pid=6457): stdout: | (launched: 2022-12-10_12:09:09.315907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:11.135271 run osmo-stp_10.42.42.5(pid=6457): stderr: | 20221210120909509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120909509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120909509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120909510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120909510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120909510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120909510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:11.290247 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6457): Process ended prematurely: osmo-stp_10.42.42.5(pid=6457) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6457)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:09:11.299761 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:09:11.327995 run osmo-hlr_10.42.42.2(pid=6454): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6454)] 12:09:11.378206 run osmo-hlr_10.42.42.2(pid=6454): stdout: | (launched: 2022-12-10_12:09:08.310228) 12:09:11.429912 run osmo-hlr_10.42.42.2(pid=6454): stderr: | 20221210120908508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120908508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120908508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120908508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120908508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120908508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120908521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120908529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120908529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120908529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:11.502201 run osmo-msc_10.42.42.6(pid=6460): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6460)] 12:09:11.552412 run osmo-msc_10.42.42.6(pid=6460): stdout: | (launched: 2022-12-10_12:09:10.354309) 12:09:11.604103 run osmo-msc_10.42.42.6(pid=6460): stderr: | 20221210120910678 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120910678 DLGLOBAL DEBUG validating counter group 0x7fa3130eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120910678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120910678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120910679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120910679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120910680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120910681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120910681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120910681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:11.656062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6453): Terminating (SIGTERM) 12:09:11.697722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6456): Terminating (SIGTERM) 12:09:11.739561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6459): Terminating (SIGTERM) 12:09:11.781656 --- ParallelTerminationStrategy: PID 6453 died... 12:09:11.801509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6453): Terminated: ok {rc=0} 12:09:11.847822 --- ParallelTerminationStrategy: PID 6456 died... 12:09:11.867280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6456): Terminated: ok {rc=0} 12:09:11.913564 --- ParallelTerminationStrategy: PID 6459 died... 12:09:11.933046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6459): Terminated: ok {rc=0} 12:09:12.020816 bus /sierra_3: Setting Powered False 12:09:13.119532 bus /sierra_3: Setting Powered False 12:09:14.236055 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:09:15.382228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:15.394270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:09:15.459296 tst mo_mt_call_osmux.py: using LAC 28295 12:09:15.577102 tst mo_mt_call_osmux.py: using RAC 245 12:09:15.699226 tst mo_mt_call_osmux.py: using CellId 28295 12:09:15.817908 tst mo_mt_call_osmux.py: using BVCI 28296 12:09:15.938887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:15.950692 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:15.962882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:15.975260 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:15.986799 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:09:15.998436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:09:16.124883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:09:16.266622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:16.790561 run create_hlr_db(pid=6463): Launched 12:09:16.955735 bus /sierra_2: Setting Powered False 12:09:18.020351 run create_hlr_db(pid=6463): Terminated: ok {rc=0} 12:09:18.454405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6465): Launched 12:09:18.757690 run osmo-hlr_10.42.42.2(pid=6466): Launched 12:09:18.873308 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:19.393934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6468): Launched 12:09:19.697076 run osmo-stp_10.42.42.5(pid=6469): Launched 12:09:19.812726 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:20.360023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6471): Launched 12:09:20.662378 run osmo-msc_10.42.42.6(pid=6472): Launched 12:09:20.831611 run osmo-stp_10.42.42.5(pid=6469): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6469)] 12:09:20.958738 run osmo-stp_10.42.42.5(pid=6469): stdout: | (launched: 2022-12-10_12:09:19.641103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:21.085671 run osmo-stp_10.42.42.5(pid=6469): stderr: | 20221210120919814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120919814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120919814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120919815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120919815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120919815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120919815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:21.211462 run osmo-stp_10.42.42.5(pid=6469): stdout: | (launched: 2022-12-10_12:09:19.641103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:21.331976 run osmo-stp_10.42.42.5(pid=6469): stderr: | 20221210120919814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120919814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120919814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120919815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120919815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120919815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120919815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:21.475817 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6469): Process ended prematurely: osmo-stp_10.42.42.5(pid=6469) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6469)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:09:21.484806 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:09:21.511711 run osmo-hlr_10.42.42.2(pid=6466): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6466)] 12:09:21.559740 run osmo-hlr_10.42.42.2(pid=6466): stdout: | (launched: 2022-12-10_12:09:18.701077) 12:09:21.608853 run osmo-hlr_10.42.42.2(pid=6466): stderr: | 20221210120918876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120918876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120918876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120918876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120918876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120918876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120918888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120918898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120918898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120918898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:21.677758 run osmo-msc_10.42.42.6(pid=6472): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6472)] 12:09:21.725386 run osmo-msc_10.42.42.6(pid=6472): stdout: | (launched: 2022-12-10_12:09:20.606815) 12:09:21.774066 run osmo-msc_10.42.42.6(pid=6472): stderr: | 20221210120920879 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120920880 DLGLOBAL DEBUG validating counter group 0x7f290ea08c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120920880 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120920880 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120920880 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120920881 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120920883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120920883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120920884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120920884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:21.823244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6465): Terminating (SIGTERM) 12:09:21.862439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6468): Terminating (SIGTERM) 12:09:21.901955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6471): Terminating (SIGTERM) 12:09:21.941884 --- ParallelTerminationStrategy: PID 6465 died... 12:09:21.960895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6465): Terminated: ok {rc=0} 12:09:22.005135 --- ParallelTerminationStrategy: PID 6468 died... 12:09:22.023758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6468): Terminated: ok {rc=0} 12:09:22.067884 --- ParallelTerminationStrategy: PID 6471 died... 12:09:22.086553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6471): Terminated: ok {rc=0} 12:09:22.170991 bus /sierra_3: Setting Powered False 12:09:23.267294 bus /sierra_3: Setting Powered False 12:09:24.382159 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:09:25.626746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:25.633123 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:09:25.662256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:09:25.688404 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:09:25.739788 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:09:25.768564 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:09:25.794926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:09:26.346958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:09:26.395713 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:26.407062 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:09:26.470484 tst mo_mt_call.py: using LAC 28296 12:09:26.587193 tst mo_mt_call.py: using RAC 246 12:09:26.709763 tst mo_mt_call.py: using CellId 28296 12:09:26.827811 tst mo_mt_call.py: using BVCI 28297 12:09:26.936311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:26.947412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:26.958427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:26.969557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:26.980843 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:26.991960 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:09:27.107961 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:09:27.222814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:27.693373 run create_hlr_db(pid=6477): Launched 12:09:27.817380 bus /sierra_2: Setting Powered False 12:09:28.882383 run create_hlr_db(pid=6477): Terminated: ok {rc=0} 12:09:29.335106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6479): Launched 12:09:29.660105 run osmo-hlr_10.42.42.2(pid=6480): Launched 12:09:29.784372 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:30.344222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6482): Launched 12:09:30.668040 run osmo-stp_10.42.42.5(pid=6483): Launched 12:09:30.791353 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:31.510630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6485): Launched 12:09:31.861452 run osmo-msc_10.42.42.6(pid=6486): Launched 12:09:32.170481 run osmo-stp_10.42.42.5(pid=6483): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6483)] 12:09:32.316047 run osmo-stp_10.42.42.5(pid=6483): stdout: | (launched: 2022-12-10_12:09:30.609024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:32.451615 run osmo-stp_10.42.42.5(pid=6483): stderr: | 20221210120930802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120930803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120930803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120930803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120930804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120930804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120930804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:32.586855 run osmo-stp_10.42.42.5(pid=6483): stdout: | (launched: 2022-12-10_12:09:30.609024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:32.716716 run osmo-stp_10.42.42.5(pid=6483): stderr: | 20221210120930802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120930803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120930803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120930803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120930804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120930804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120930804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:32.871858 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6483): Process ended prematurely: osmo-stp_10.42.42.5(pid=6483) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6483)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:09:32.881662 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:09:32.910317 run osmo-hlr_10.42.42.2(pid=6480): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6480)] 12:09:32.960839 run osmo-hlr_10.42.42.2(pid=6480): stdout: | (launched: 2022-12-10_12:09:29.600899) 12:09:33.012774 run osmo-hlr_10.42.42.2(pid=6480): stderr: | 20221210120929798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120929798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120929798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120929798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120929798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120929798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120929810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120929819 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120929819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120929819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:33.085150 run osmo-msc_10.42.42.6(pid=6486): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6486)] 12:09:33.135547 run osmo-msc_10.42.42.6(pid=6486): stdout: | (launched: 2022-12-10_12:09:31.797466) 12:09:33.187495 run osmo-msc_10.42.42.6(pid=6486): stderr: | 20221210120932272 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120932272 DLGLOBAL DEBUG validating counter group 0x7fce6dfadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120932272 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120932272 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120932272 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120932273 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120932274 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120932275 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120932275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120932275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:33.240347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6479): Terminating (SIGTERM) 12:09:33.283039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6482): Terminating (SIGTERM) 12:09:33.325211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6485): Terminating (SIGTERM) 12:09:33.367502 --- ParallelTerminationStrategy: PID 6479 died... 12:09:33.387319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6479): Terminated: ok {rc=0} 12:09:33.434411 --- ParallelTerminationStrategy: PID 6482 died... 12:09:33.454198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6482): Terminated: ok {rc=0} 12:09:33.500803 --- ParallelTerminationStrategy: PID 6485 died... 12:09:33.520829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6485): Terminated: ok {rc=0} 12:09:33.609745 bus /sierra_3: Setting Powered False 12:09:34.707607 bus /sierra_3: Setting Powered False 12:09:35.822363 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:09:36.971892 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:36.984342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:09:37.051032 tst mo_mt_call_osmux.py: using LAC 28297 12:09:37.178146 tst mo_mt_call_osmux.py: using RAC 247 12:09:37.306879 tst mo_mt_call_osmux.py: using CellId 28297 12:09:37.435099 tst mo_mt_call_osmux.py: using BVCI 28298 12:09:37.552567 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:37.564285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:37.575753 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:37.587671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:37.599447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:09:37.611101 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:09:37.728061 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:09:37.846332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:38.349886 run create_hlr_db(pid=6488): Launched 12:09:38.473676 bus /sierra_2: Setting Powered False 12:09:39.538460 run create_hlr_db(pid=6488): Terminated: ok {rc=0} 12:09:39.989503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6490): Launched 12:09:40.314375 run osmo-hlr_10.42.42.2(pid=6491): Launched 12:09:40.438667 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:40.999820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6493): Launched 12:09:41.324471 run osmo-stp_10.42.42.5(pid=6494): Launched 12:09:41.447969 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:42.030815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6496): Launched 12:09:42.355960 run osmo-msc_10.42.42.6(pid=6497): Launched 12:09:42.537716 run osmo-stp_10.42.42.5(pid=6494): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6494)] 12:09:42.675110 run osmo-stp_10.42.42.5(pid=6494): stdout: | (launched: 2022-12-10_12:09:41.265290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:42.812402 run osmo-stp_10.42.42.5(pid=6494): stderr: | 20221210120941457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120941457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120941458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120941458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120941460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120941461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120941461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:42.948785 run osmo-stp_10.42.42.5(pid=6494): stdout: | (launched: 2022-12-10_12:09:41.265290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:43.078256 run osmo-stp_10.42.42.5(pid=6494): stderr: | 20221210120941457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120941457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120941458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120941458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120941460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120941461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120941461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:43.233643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6494): Process ended prematurely: osmo-stp_10.42.42.5(pid=6494) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6494)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:09:43.243208 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:09:43.272062 run osmo-hlr_10.42.42.2(pid=6491): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6491)] 12:09:43.322651 run osmo-hlr_10.42.42.2(pid=6491): stdout: | (launched: 2022-12-10_12:09:40.255084) 12:09:43.374625 run osmo-hlr_10.42.42.2(pid=6491): stderr: | 20221210120940453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120940453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120940453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120940453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120940453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120940453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120940466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120940474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120940474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120940474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:43.447390 run osmo-msc_10.42.42.6(pid=6497): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6497)] 12:09:43.497611 run osmo-msc_10.42.42.6(pid=6497): stdout: | (launched: 2022-12-10_12:09:42.296595) 12:09:43.549596 run osmo-msc_10.42.42.6(pid=6497): stderr: | 20221210120942618 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120942618 DLGLOBAL DEBUG validating counter group 0x7fe975df1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120942618 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120942618 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120942618 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120942618 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120942620 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120942621 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120942621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120942621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:43.602090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6490): Terminating (SIGTERM) 12:09:43.643826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6493): Terminating (SIGTERM) 12:09:43.685997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6496): Terminating (SIGTERM) 12:09:43.728402 --- ParallelTerminationStrategy: PID 6490 died... 12:09:43.748410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6490): Terminated: ok {rc=0} 12:09:43.795303 --- ParallelTerminationStrategy: PID 6493 died... 12:09:43.814914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6493): Terminated: ok {rc=0} 12:09:43.861545 --- ParallelTerminationStrategy: PID 6496 died... 12:09:43.881253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6496): Terminated: ok {rc=0} 12:09:43.969571 bus /sierra_3: Setting Powered False 12:09:45.067357 bus /sierra_3: Setting Powered False 12:09:46.209251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:09:47.470618 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:47.476770 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:09:47.505451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:09:47.532004 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:09:47.583144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:09:47.613141 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:09:47.640458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:09:48.194223 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:09:48.242551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:48.253795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:09:48.316662 tst mo_mt_call.py: using LAC 28298 12:09:48.434199 tst mo_mt_call.py: using RAC 248 12:09:48.551192 tst mo_mt_call.py: using CellId 28298 12:09:48.668383 tst mo_mt_call.py: using BVCI 28299 12:09:48.777606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:48.788592 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:48.799508 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:48.810657 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:48.821674 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:48.832499 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:09:48.948129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:09:49.069457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:49.573539 run create_hlr_db(pid=6502): Launched 12:09:49.698478 bus /sierra_2: Setting Powered False 12:09:50.762788 run create_hlr_db(pid=6502): Terminated: ok {rc=0} 12:09:51.197646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6504): Launched 12:09:51.500656 run osmo-hlr_10.42.42.2(pid=6505): Launched 12:09:51.618308 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:52.154681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6507): Launched 12:09:52.456421 run osmo-stp_10.42.42.5(pid=6508): Launched 12:09:52.571308 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:53.130176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6510): Launched 12:09:53.432516 run osmo-msc_10.42.42.6(pid=6511): Launched 12:09:53.602185 run osmo-stp_10.42.42.5(pid=6508): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6508)] 12:09:53.730861 run osmo-stp_10.42.42.5(pid=6508): stdout: | (launched: 2022-12-10_12:09:52.400755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:53.858688 run osmo-stp_10.42.42.5(pid=6508): stderr: | 20221210120952574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120952574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120952575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120952575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120952575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120952576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120952576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:53.983632 run osmo-stp_10.42.42.5(pid=6508): stdout: | (launched: 2022-12-10_12:09:52.400755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:54.103832 run osmo-stp_10.42.42.5(pid=6508): stderr: | 20221210120952574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210120952574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210120952575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210120952575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210120952575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210120952576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210120952576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:54.247743 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6508): Process ended prematurely: osmo-stp_10.42.42.5(pid=6508) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6508)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:09:54.256555 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:09:54.282970 run osmo-hlr_10.42.42.2(pid=6505): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6505)] 12:09:54.329720 run osmo-hlr_10.42.42.2(pid=6505): stdout: | (launched: 2022-12-10_12:09:51.445341) 12:09:54.378850 run osmo-hlr_10.42.42.2(pid=6505): stderr: | 20221210120951624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210120951624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210120951624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210120951624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210120951624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210120951624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210120951636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210120951645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210120951646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210120951646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:54.446628 run osmo-msc_10.42.42.6(pid=6511): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6511)] 12:09:54.493402 run osmo-msc_10.42.42.6(pid=6511): stdout: | (launched: 2022-12-10_12:09:53.376869) 12:09:54.541611 run osmo-msc_10.42.42.6(pid=6511): stderr: | 20221210120953649 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210120953649 DLGLOBAL DEBUG validating counter group 0x7f569f3a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210120953649 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210120953650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210120953650 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210120953650 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210120953653 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210120953653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210120953653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210120953653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:54.590155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6504): Terminating (SIGTERM) 12:09:54.629045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6507): Terminating (SIGTERM) 12:09:54.667876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6510): Terminating (SIGTERM) 12:09:54.707164 --- ParallelTerminationStrategy: PID 6504 died... 12:09:54.725984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6504): Terminated: ok {rc=0} 12:09:54.769433 --- ParallelTerminationStrategy: PID 6507 died... 12:09:54.787683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6507): Terminated: ok {rc=0} 12:09:54.831561 --- ParallelTerminationStrategy: PID 6510 died... 12:09:54.850034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6510): Terminated: ok {rc=0} 12:09:54.935169 bus /sierra_3: Setting Powered False 12:09:56.034917 bus /sierra_3: Setting Powered False 12:09:57.151077 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:09:58.302187 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:58.314623 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:09:58.384039 tst mo_mt_call_osmux.py: using LAC 28299 12:09:58.510632 tst mo_mt_call_osmux.py: using RAC 249 12:09:58.634449 tst mo_mt_call_osmux.py: using CellId 28299 12:09:58.759470 tst mo_mt_call_osmux.py: using BVCI 28300 12:09:58.869867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:58.881089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:58.892150 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:58.903086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:58.914151 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:09:58.925138 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:09:59.043049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:09:59.162305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:59.632077 run create_hlr_db(pid=6513): Launched 12:09:59.755342 bus /sierra_2: Setting Powered False 12:10:00.819778 run create_hlr_db(pid=6513): Terminated: ok {rc=0} 12:10:01.326606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6518): Launched 12:10:01.670630 run osmo-hlr_10.42.42.2(pid=6519): Launched 12:10:01.920424 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:02.561958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6521): Launched 12:10:02.865299 run osmo-stp_10.42.42.5(pid=6522): Launched 12:10:02.981443 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:03.527868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6524): Launched 12:10:03.831831 run osmo-msc_10.42.42.6(pid=6525): Launched 12:10:04.001990 run osmo-stp_10.42.42.5(pid=6522): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6522)] 12:10:04.129804 run osmo-stp_10.42.42.5(pid=6522): stdout: | (launched: 2022-12-10_12:10:02.809682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:04.257828 run osmo-stp_10.42.42.5(pid=6522): stderr: | 20221210121002981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121002981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121002981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121002982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121002982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121002982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121002982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:04.383413 run osmo-stp_10.42.42.5(pid=6522): stdout: | (launched: 2022-12-10_12:10:02.809682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:04.504448 run osmo-stp_10.42.42.5(pid=6522): stderr: | 20221210121002981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121002981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121002981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121002982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121002982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121002982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121002982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:04.648910 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6522): Process ended prematurely: osmo-stp_10.42.42.5(pid=6522) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6522)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:10:04.657832 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:10:04.684154 run osmo-hlr_10.42.42.2(pid=6519): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6519)] 12:10:04.730977 run osmo-hlr_10.42.42.2(pid=6519): stdout: | (launched: 2022-12-10_12:10:01.601489) 12:10:04.779462 run osmo-hlr_10.42.42.2(pid=6519): stderr: | 20221210121001900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121001900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121001900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121001913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121001913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121001913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121001931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121001948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121001948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121001948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:04.847760 run osmo-msc_10.42.42.6(pid=6525): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6525)] 12:10:04.894669 run osmo-msc_10.42.42.6(pid=6525): stdout: | (launched: 2022-12-10_12:10:03.776004) 12:10:04.943216 run osmo-msc_10.42.42.6(pid=6525): stderr: | 20221210121004047 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121004048 DLGLOBAL DEBUG validating counter group 0x7f954bdc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121004048 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121004048 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121004048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121004048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121004050 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121004050 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121004050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121004051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:04.992189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6518): Terminating (SIGTERM) 12:10:05.031037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6521): Terminating (SIGTERM) 12:10:05.069962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6524): Terminating (SIGTERM) 12:10:05.109393 --- ParallelTerminationStrategy: PID 6518 died... 12:10:05.128333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6518): Terminated: ok {rc=0} 12:10:05.171678 --- ParallelTerminationStrategy: PID 6521 died... 12:10:05.189942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6521): Terminated: ok {rc=0} 12:10:05.233395 --- ParallelTerminationStrategy: PID 6524 died... 12:10:05.251945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6524): Terminated: ok {rc=0} 12:10:05.336461 bus /sierra_3: Setting Powered False 12:10:06.434523 bus /sierra_3: Setting Powered False 12:10:07.550698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:10:08.794481 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:08.800566 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:10:08.829160 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:10:08.855104 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:10:08.910574 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:10:08.939499 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:10:08.965504 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:10:09.513887 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:10:09.562266 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:09.573641 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:10:09.637404 tst mo_mt_call.py: using LAC 28300 12:10:09.753813 tst mo_mt_call.py: using RAC 250 12:10:09.870190 tst mo_mt_call.py: using CellId 28300 12:10:09.986730 tst mo_mt_call.py: using BVCI 28301 12:10:10.095742 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:10.107040 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:10.118046 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:10.129060 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:10.140080 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:10.151078 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:10.270599 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:10.386497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:10.856271 run create_hlr_db(pid=6531): Launched 12:10:10.979625 bus /sierra_2: Setting Powered False 12:10:12.040676 run create_hlr_db(pid=6531): Terminated: ok {rc=0} 12:10:12.485109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6533): Launched 12:10:12.810465 run osmo-hlr_10.42.42.2(pid=6534): Launched 12:10:12.934516 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:13.494732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6536): Launched 12:10:13.819184 run osmo-stp_10.42.42.5(pid=6537): Launched 12:10:13.942785 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:14.528788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6539): Launched 12:10:14.853112 run osmo-msc_10.42.42.6(pid=6540): Launched 12:10:15.033530 run osmo-stp_10.42.42.5(pid=6537): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6537)] 12:10:15.170160 run osmo-stp_10.42.42.5(pid=6537): stdout: | (launched: 2022-12-10_12:10:13.759924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:15.307938 run osmo-stp_10.42.42.5(pid=6537): stderr: | 20221210121013951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121013951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121013951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121013951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121013952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121013952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121013952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:15.444247 run osmo-stp_10.42.42.5(pid=6537): stdout: | (launched: 2022-12-10_12:10:13.759924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:15.574273 run osmo-stp_10.42.42.5(pid=6537): stderr: | 20221210121013951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121013951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121013951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121013951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121013952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121013952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121013952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:15.729545 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6537): Process ended prematurely: osmo-stp_10.42.42.5(pid=6537) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6537)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:10:15.739227 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:10:15.768287 run osmo-hlr_10.42.42.2(pid=6534): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6534)] 12:10:15.818455 run osmo-hlr_10.42.42.2(pid=6534): stdout: | (launched: 2022-12-10_12:10:12.751408) 12:10:15.880533 run osmo-hlr_10.42.42.2(pid=6534): stderr: | 20221210121012950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121012950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121012950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121012950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121012950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121012950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121012962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121012970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121012970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121012970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:15.954786 run osmo-msc_10.42.42.6(pid=6540): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6540)] 12:10:16.005670 run osmo-msc_10.42.42.6(pid=6540): stdout: | (launched: 2022-12-10_12:10:14.793847) 12:10:16.057961 run osmo-msc_10.42.42.6(pid=6540): stderr: | 20221210121015114 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121015114 DLGLOBAL DEBUG validating counter group 0x7f7e8ae2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121015114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121015114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121015114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121015115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121015116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121015117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121015117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121015117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:16.110730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6533): Terminating (SIGTERM) 12:10:16.153571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6536): Terminating (SIGTERM) 12:10:16.196126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6539): Terminating (SIGTERM) 12:10:16.239660 --- ParallelTerminationStrategy: PID 6533 died... 12:10:16.260217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6533): Terminated: ok {rc=0} 12:10:16.308665 --- ParallelTerminationStrategy: PID 6536 died... 12:10:16.328797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6536): Terminated: ok {rc=0} 12:10:16.376635 --- ParallelTerminationStrategy: PID 6539 died... 12:10:16.396782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6539): Terminated: ok {rc=0} 12:10:16.485123 bus /sierra_3: Setting Powered False 12:10:17.586811 bus /sierra_3: Setting Powered False 12:10:18.700173 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:10:19.849992 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:19.862537 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:10:19.931250 tst mo_mt_call_osmux.py: using LAC 28301 12:10:20.058881 tst mo_mt_call_osmux.py: using RAC 251 12:10:20.186782 tst mo_mt_call_osmux.py: using CellId 28301 12:10:20.314455 tst mo_mt_call_osmux.py: using BVCI 28302 12:10:20.434133 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:20.446207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:20.458034 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:20.470216 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:20.482350 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:10:20.494504 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:20.615930 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:20.731857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:21.203893 run create_hlr_db(pid=6542): Launched 12:10:21.329467 bus /sierra_2: Setting Powered False 12:10:22.390454 run create_hlr_db(pid=6542): Terminated: ok {rc=0} 12:10:22.833666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6544): Launched 12:10:23.158833 run osmo-hlr_10.42.42.2(pid=6545): Launched 12:10:23.283454 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:23.839830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6547): Launched 12:10:24.160862 run osmo-stp_10.42.42.5(pid=6548): Launched 12:10:24.285327 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:24.863260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6550): Launched 12:10:25.183003 run osmo-msc_10.42.42.6(pid=6551): Launched 12:10:25.362646 run osmo-stp_10.42.42.5(pid=6548): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6548)] 12:10:25.497454 run osmo-stp_10.42.42.5(pid=6548): stdout: | (launched: 2022-12-10_12:10:24.101346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:25.632509 run osmo-stp_10.42.42.5(pid=6548): stderr: | 20221210121024295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121024296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121024296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121024296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121024297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121024297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121024297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:25.767473 run osmo-stp_10.42.42.5(pid=6548): stdout: | (launched: 2022-12-10_12:10:24.101346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:25.895084 run osmo-stp_10.42.42.5(pid=6548): stderr: | 20221210121024295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121024296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121024296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121024296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121024297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121024297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121024297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:26.047852 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6548): Process ended prematurely: osmo-stp_10.42.42.5(pid=6548) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6548)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:10:26.057524 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:10:26.085685 run osmo-hlr_10.42.42.2(pid=6545): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6545)] 12:10:26.135609 run osmo-hlr_10.42.42.2(pid=6545): stdout: | (launched: 2022-12-10_12:10:23.099439) 12:10:26.186786 run osmo-hlr_10.42.42.2(pid=6545): stderr: | 20221210121023297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121023297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121023297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121023297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121023297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121023297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121023310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121023318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121023318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121023318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:26.258608 run osmo-msc_10.42.42.6(pid=6551): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6551)] 12:10:26.308193 run osmo-msc_10.42.42.6(pid=6551): stdout: | (launched: 2022-12-10_12:10:25.124536) 12:10:26.359373 run osmo-msc_10.42.42.6(pid=6551): stderr: | 20221210121025444 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121025444 DLGLOBAL DEBUG validating counter group 0x7f41a3dfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121025444 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121025444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121025445 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121025445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121025446 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121025447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121025447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121025447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:26.410721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6544): Terminating (SIGTERM) 12:10:26.452008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6547): Terminating (SIGTERM) 12:10:26.493538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6550): Terminating (SIGTERM) 12:10:26.535352 --- ParallelTerminationStrategy: PID 6544 died... 12:10:26.555212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6544): Terminated: ok {rc=0} 12:10:26.601572 --- ParallelTerminationStrategy: PID 6547 died... 12:10:26.620868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6547): Terminated: ok {rc=0} 12:10:26.667124 --- ParallelTerminationStrategy: PID 6550 died... 12:10:26.686519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6550): Terminated: ok {rc=0} 12:10:26.774789 bus /sierra_3: Setting Powered False 12:10:27.872084 bus /sierra_3: Setting Powered False 12:10:28.987973 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:10:30.236104 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:30.241562 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:10:30.269956 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:10:30.296165 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:10:30.347274 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:10:30.375920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:10:30.401928 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:10:30.977016 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:10:31.034239 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:31.046765 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:10:31.120136 tst mo_mt_call.py: using LAC 28302 12:10:31.248372 tst mo_mt_call.py: using RAC 252 12:10:31.369382 tst mo_mt_call.py: using CellId 28302 12:10:31.531999 tst mo_mt_call.py: using BVCI 28303 12:10:31.655408 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:31.668161 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:31.680617 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:31.695129 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:31.708860 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:31.722333 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:10:31.845952 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:10:31.966198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:32.467524 run create_hlr_db(pid=6556): Launched 12:10:32.591146 bus /sierra_2: Setting Powered False 12:10:33.651029 run create_hlr_db(pid=6556): Terminated: ok {rc=0} 12:10:34.087354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Launched 12:10:34.408033 run osmo-hlr_10.42.42.2(pid=6559): Launched 12:10:34.530685 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:35.081375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Launched 12:10:35.401439 run osmo-stp_10.42.42.5(pid=6562): Launched 12:10:35.523762 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:36.099889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6564): Launched 12:10:36.420192 run osmo-msc_10.42.42.6(pid=6565): Launched 12:10:36.599069 run osmo-stp_10.42.42.5(pid=6562): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] 12:10:36.734560 run osmo-stp_10.42.42.5(pid=6562): stdout: | (launched: 2022-12-10_12:10:35.343490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:36.870294 run osmo-stp_10.42.42.5(pid=6562): stderr: | 20221210121035535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121035536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121035536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121035536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121035537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121035537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121035537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:37.005285 run osmo-stp_10.42.42.5(pid=6562): stdout: | (launched: 2022-12-10_12:10:35.343490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:37.133312 run osmo-stp_10.42.42.5(pid=6562): stderr: | 20221210121035535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121035536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121035536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121035536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121035537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121035537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121035537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:37.286461 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6562): Process ended prematurely: osmo-stp_10.42.42.5(pid=6562) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:10:37.295976 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:10:37.324486 run osmo-hlr_10.42.42.2(pid=6559): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6559)] 12:10:37.374040 run osmo-hlr_10.42.42.2(pid=6559): stdout: | (launched: 2022-12-10_12:10:34.350016) 12:10:37.425484 run osmo-hlr_10.42.42.2(pid=6559): stderr: | 20221210121034547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121034547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121034547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121034547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121034547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121034547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121034560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121034569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121034569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121034569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:37.500107 run osmo-msc_10.42.42.6(pid=6565): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6565)] 12:10:37.548430 run osmo-msc_10.42.42.6(pid=6565): stdout: | (launched: 2022-12-10_12:10:36.361968) 12:10:37.598875 run osmo-msc_10.42.42.6(pid=6565): stderr: | 20221210121036684 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121036684 DLGLOBAL DEBUG validating counter group 0x7fabee088c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121036684 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121036684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121036684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121036684 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121036688 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121036688 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121036688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121036689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:37.648434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Terminating (SIGTERM) 12:10:37.688055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Terminating (SIGTERM) 12:10:37.727874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6564): Terminating (SIGTERM) 12:10:37.768286 --- ParallelTerminationStrategy: PID 6558 died... 12:10:37.787338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Terminated: ok {rc=0} 12:10:37.831936 --- ParallelTerminationStrategy: PID 6561 died... 12:10:37.850639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Terminated: ok {rc=0} 12:10:37.895669 --- ParallelTerminationStrategy: PID 6564 died... 12:10:37.914523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6564): Terminated: ok {rc=0} 12:10:38.001706 bus /sierra_3: Setting Powered False 12:10:39.103194 bus /sierra_3: Setting Powered False 12:10:40.218191 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:10:41.367570 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:41.379775 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:10:41.447992 tst mo_mt_call_osmux.py: using LAC 28303 12:10:41.572694 tst mo_mt_call_osmux.py: using RAC 253 12:10:41.697423 tst mo_mt_call_osmux.py: using CellId 28303 12:10:41.822375 tst mo_mt_call_osmux.py: using BVCI 28304 12:10:41.951463 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:41.963053 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:41.974266 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:41.985807 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:41.997371 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:10:42.009559 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:10:42.130693 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:10:42.245263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:42.709092 run create_hlr_db(pid=6567): Launched 12:10:42.832707 bus /sierra_2: Setting Powered False 12:10:43.893492 run create_hlr_db(pid=6567): Terminated: ok {rc=0} 12:10:44.310208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Launched 12:10:44.609098 run osmo-hlr_10.42.42.2(pid=6570): Launched 12:10:44.721990 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:45.249510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Launched 12:10:45.546912 run osmo-stp_10.42.42.5(pid=6573): Launched 12:10:45.659568 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:46.211753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6575): Launched 12:10:46.539417 run osmo-msc_10.42.42.6(pid=6576): Launched 12:10:47.030802 run osmo-stp_10.42.42.5(pid=6573): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] 12:10:47.214687 run osmo-stp_10.42.42.5(pid=6573): stdout: | (launched: 2022-12-10_12:10:45.492510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:47.352414 run osmo-stp_10.42.42.5(pid=6573): stderr: | 20221210121045664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121045664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121045664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121045665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121045667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121045667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121045667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:47.486073 run osmo-stp_10.42.42.5(pid=6573): stdout: | (launched: 2022-12-10_12:10:45.492510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:47.604648 run osmo-stp_10.42.42.5(pid=6573): stderr: | 20221210121045664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121045664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121045664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121045665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121045667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121045667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121045667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:47.746960 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6573): Process ended prematurely: osmo-stp_10.42.42.5(pid=6573) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:10:47.755763 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:10:47.782345 run osmo-hlr_10.42.42.2(pid=6570): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6570)] 12:10:47.829890 run osmo-hlr_10.42.42.2(pid=6570): stdout: | (launched: 2022-12-10_12:10:44.554145) 12:10:47.879213 run osmo-hlr_10.42.42.2(pid=6570): stderr: | 20221210121044731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121044731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121044731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121044732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121044732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121044732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121044744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121044753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121044753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121044753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:47.948487 run osmo-msc_10.42.42.6(pid=6576): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6576)] 12:10:47.996125 run osmo-msc_10.42.42.6(pid=6576): stdout: | (launched: 2022-12-10_12:10:46.484829) 12:10:48.045364 run osmo-msc_10.42.42.6(pid=6576): stderr: | 20221210121046849 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121046849 DLGLOBAL DEBUG validating counter group 0x7f069d428c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121046849 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121046849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121046849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121046849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121046853 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121046854 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121046854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121046854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:48.094876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Terminating (SIGTERM) 12:10:48.134447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Terminating (SIGTERM) 12:10:48.173824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6575): Terminating (SIGTERM) 12:10:48.213588 --- ParallelTerminationStrategy: PID 6569 died... 12:10:48.232112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Terminated: ok {rc=0} 12:10:48.276462 --- ParallelTerminationStrategy: PID 6572 died... 12:10:48.295075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Terminated: ok {rc=0} 12:10:48.338902 --- ParallelTerminationStrategy: PID 6575 died... 12:10:48.357489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6575): Terminated: ok {rc=0} 12:10:48.442672 bus /sierra_3: Setting Powered False 12:10:49.540326 bus /sierra_3: Setting Powered False 12:10:50.653939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 12:10:51.896726 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:51.901377 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:10:51.930037 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:10:51.955987 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:10:52.038366 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:10:52.066885 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:10:52.092856 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:10:52.677615 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 12:10:52.682455 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:10:52.693153 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:10:52.737654 tst emergency_mo_mt_call.py: using LAC 28304 12:10:52.851524 tst emergency_mo_mt_call.py: using RAC 254 12:10:52.965406 tst emergency_mo_mt_call.py: using CellId 28304 12:10:53.089217 tst emergency_mo_mt_call.py: using BVCI 28305 12:10:53.205358 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:10:53.216673 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:10:53.227907 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:10:53.239309 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:10:53.250899 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:10:53.262566 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:10:53.377116 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:10:53.489429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:53.943845 run create_hlr_db(pid=6582): Launched 12:10:54.064616 bus /sierra_2: Setting Powered False 12:10:55.124373 run create_hlr_db(pid=6582): Terminated: ok {rc=0} 12:10:55.555218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6584): Launched 12:10:55.870343 run osmo-hlr_10.42.42.2(pid=6585): Launched 12:10:55.990911 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:56.534911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6587): Launched 12:10:56.848848 run osmo-stp_10.42.42.5(pid=6588): Launched 12:10:56.979299 tst emergency_mo_mt_call.py: using MSISDN 7724 12:10:57.136932 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:57.706414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6590): Launched 12:10:58.020153 run osmo-msc_10.42.42.6(pid=6591): Launched 12:10:58.195809 run osmo-stp_10.42.42.5(pid=6588): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6588)] 12:10:58.329530 run osmo-stp_10.42.42.5(pid=6588): stdout: | (launched: 2022-12-10_12:10:56.791423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:58.462412 run osmo-stp_10.42.42.5(pid=6588): stderr: | 20221210121056982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121056982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121056982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121056983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121056983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121056983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121056983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:58.595395 run osmo-stp_10.42.42.5(pid=6588): stdout: | (launched: 2022-12-10_12:10:56.791423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:58.720821 run osmo-stp_10.42.42.5(pid=6588): stderr: | 20221210121056982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121056982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121056982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121056983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121056983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121056983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121056983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:58.871322 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6588): Process ended prematurely: osmo-stp_10.42.42.5(pid=6588) [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6588)] [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 12:10:58.880216 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 12:10:58.908427 run osmo-hlr_10.42.42.2(pid=6585): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6585)] 12:10:58.958603 run osmo-hlr_10.42.42.2(pid=6585): stdout: | (launched: 2022-12-10_12:10:55.813282) 12:10:59.010447 run osmo-hlr_10.42.42.2(pid=6585): stderr: | 20221210121056009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121056009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121056009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121056009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121056009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121056010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121056022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121056030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121056030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121056030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:59.082637 run osmo-msc_10.42.42.6(pid=6591): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6591)] 12:10:59.132802 run osmo-msc_10.42.42.6(pid=6591): stdout: | (launched: 2022-12-10_12:10:57.962586) 12:10:59.184537 run osmo-msc_10.42.42.6(pid=6591): stderr: | 20221210121058282 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121058282 DLGLOBAL DEBUG validating counter group 0x7f487f12dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121058282 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121058282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121058282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121058283 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121058284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121058285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121058285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121058285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:59.236820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6584): Terminating (SIGTERM) 12:10:59.278644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6587): Terminating (SIGTERM) 12:10:59.320504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6590): Terminating (SIGTERM) 12:10:59.362537 --- ParallelTerminationStrategy: PID 6584 died... 12:10:59.382473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6584): Terminated: ok {rc=0} 12:10:59.429117 --- ParallelTerminationStrategy: PID 6587 died... 12:10:59.448694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6587): Terminated: ok {rc=0} 12:10:59.495048 --- ParallelTerminationStrategy: PID 6590 died... 12:10:59.514538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6590): Terminated: ok {rc=0} 12:10:59.603032 bus /sierra_3: Setting Powered False 12:11:00.699989 bus /sierra_3: Setting Powered False 12:11:01.814081 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 12:11:02.903282 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:02.915184 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:02.962326 tst emergency_preemptive_call.py: using LAC 28305 12:11:03.092023 tst emergency_preemptive_call.py: using RAC 255 12:11:03.213669 tst emergency_preemptive_call.py: using CellId 28305 12:11:03.334549 tst emergency_preemptive_call.py: using BVCI 28306 12:11:03.447686 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:03.458972 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:03.470002 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:03.481141 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:03.492347 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:03.503532 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:03.620505 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:03.733254 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:03.846221 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:03.958669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:04.414585 run create_hlr_db(pid=6593): Launched 12:11:04.535416 bus /sierra_2: Setting Powered False 12:11:05.593979 run create_hlr_db(pid=6593): Terminated: ok {rc=0} 12:11:06.023413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6595): Launched 12:11:06.336774 run osmo-hlr_10.42.42.2(pid=6596): Launched 12:11:06.457323 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:07.004285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6598): Launched 12:11:07.319530 run osmo-stp_10.42.42.5(pid=6599): Launched 12:11:07.449575 tst emergency_preemptive_call.py: using MSISDN 7725 12:11:07.613505 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:08.176719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6601): Launched 12:11:08.491158 run osmo-msc_10.42.42.6(pid=6602): Launched 12:11:08.667910 run osmo-stp_10.42.42.5(pid=6599): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6599)] 12:11:08.801271 run osmo-stp_10.42.42.5(pid=6599): stdout: | (launched: 2022-12-10_12:11:07.261688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:08.934887 run osmo-stp_10.42.42.5(pid=6599): stderr: | 20221210121107453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121107453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121107453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121107454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121107456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121107456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121107456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:09.067645 run osmo-stp_10.42.42.5(pid=6599): stdout: | (launched: 2022-12-10_12:11:07.261688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:09.193619 run osmo-stp_10.42.42.5(pid=6599): stderr: | 20221210121107453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121107453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121107453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121107454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121107456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121107456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121107456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:09.344755 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6599): Process ended prematurely: osmo-stp_10.42.42.5(pid=6599) [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6599)] [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 12:11:09.353727 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 12:11:09.381642 run osmo-hlr_10.42.42.2(pid=6596): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6596)] 12:11:09.431627 run osmo-hlr_10.42.42.2(pid=6596): stdout: | (launched: 2022-12-10_12:11:06.279651) 12:11:09.483498 run osmo-hlr_10.42.42.2(pid=6596): stderr: | 20221210121106476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121106476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121106476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121106477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121106477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121106477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121106489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121106498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121106498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121106498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:09.555490 run osmo-msc_10.42.42.6(pid=6602): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6602)] 12:11:09.605523 run osmo-msc_10.42.42.6(pid=6602): stdout: | (launched: 2022-12-10_12:11:08.433853) 12:11:09.656890 run osmo-msc_10.42.42.6(pid=6602): stderr: | 20221210121108754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121108754 DLGLOBAL DEBUG validating counter group 0x7f14221cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121108755 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121108755 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121108755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121108755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121108757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121108757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121108757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121108757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:09.709109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6595): Terminating (SIGTERM) 12:11:09.750666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6598): Terminating (SIGTERM) 12:11:09.792352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6601): Terminating (SIGTERM) 12:11:09.834448 --- ParallelTerminationStrategy: PID 6595 died... 12:11:09.854345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6595): Terminated: ok {rc=0} 12:11:09.900681 --- ParallelTerminationStrategy: PID 6598 died... 12:11:09.920207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6598): Terminated: ok {rc=0} 12:11:09.966412 --- ParallelTerminationStrategy: PID 6601 died... 12:11:09.985892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6601): Terminated: ok {rc=0} 12:11:10.073491 bus /sierra_9: Setting Powered False 12:11:11.171497 bus /sierra_9: Setting Powered False 12:11:12.286902 bus /sierra_8: Setting Powered False 12:11:13.386191 bus /sierra_8: Setting Powered False 12:11:14.500755 bus /sierra_3: Setting Powered False 12:11:15.597489 bus /sierra_3: Setting Powered False 12:11:16.710370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 12:11:17.978133 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:17.983632 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:11:18.013915 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 12:11:18.053125 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:11:18.140856 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:11:18.170647 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 12:11:18.209841 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:11:18.802800 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 12:11:18.855503 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:18.866631 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:18.912311 tst cs_paging_gprs_active.py: using LAC 28306 12:11:19.038058 tst cs_paging_gprs_active.py: using RAC 1 12:11:19.162576 tst cs_paging_gprs_active.py: using CellId 28306 12:11:19.287071 tst cs_paging_gprs_active.py: using BVCI 28307 12:11:19.403217 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.414358 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.425307 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.436318 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.447365 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.458795 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.469967 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.481022 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:19.492255 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:19.606827 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:19.723202 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:11:19.925907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:11:20.226168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6607): Launched 12:11:20.486635 run iperf3-srv_10.42.42.10(pid=6608): Launched 12:11:20.598851 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:11:20.799103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:11:21.099898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6609): Launched 12:11:21.361159 run iperf3-srv_10.42.42.10(pid=6610): Launched 12:11:21.473242 tst cs_paging_gprs_active.py:38: start network... 12:11:21.673285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:22.136427 run create_hlr_db(pid=6611): Launched 12:11:22.259089 bus /sierra_2: Setting Powered False 12:11:23.319292 run create_hlr_db(pid=6611): Terminated: ok {rc=0} 12:11:23.757574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6613): Launched 12:11:24.079376 run osmo-hlr_10.42.42.2(pid=6614): Launched 12:11:24.202580 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:24.757086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6616): Launched 12:11:25.077153 run osmo-stp_10.42.42.5(pid=6617): Launched 12:11:25.199722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:11:25.753595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6619): Launched 12:11:25.877083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:11:26.148041 run patchelf(pid=6620): Launched 12:11:26.327145 run osmo-stp_10.42.42.5(pid=6617): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6617)] 12:11:26.463750 run osmo-stp_10.42.42.5(pid=6617): stdout: | (launched: 2022-12-10_12:11:25.018786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:26.601604 run osmo-stp_10.42.42.5(pid=6617): stderr: | 20221210121125212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121125212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121125212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121125212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121125213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121125213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121125213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:26.739446 run osmo-stp_10.42.42.5(pid=6617): stdout: | (launched: 2022-12-10_12:11:25.018786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:26.871073 run osmo-stp_10.42.42.5(pid=6617): stderr: | 20221210121125212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121125212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121125212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121125212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121125213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121125213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121125213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:27.027353 run patchelf(pid=6620): Terminating (SIGINT) 12:11:27.207616 run patchelf(pid=6620): Terminated: ok {rc=0} 12:11:27.337787 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6617): Process ended prematurely: osmo-stp_10.42.42.5(pid=6617) [trial-2374↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6617)] [trial-2374↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 12:11:27.347765 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 12:11:27.376688 run osmo-hlr_10.42.42.2(pid=6614): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6614)] 12:11:27.426460 run osmo-hlr_10.42.42.2(pid=6614): stdout: | (launched: 2022-12-10_12:11:24.020556) 12:11:27.477991 run osmo-hlr_10.42.42.2(pid=6614): stderr: | 20221210121124220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121124220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121124220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121124220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121124220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121124220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121124231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121124240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121124240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121124240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:27.529761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6607): Terminating (SIGTERM) 12:11:27.571367 run iperf3-srv_10.42.42.10(pid=6608): Terminating (SIGTERM) 12:11:27.612865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6609): Terminating (SIGTERM) 12:11:27.654607 run iperf3-srv_10.42.42.10(pid=6610): Terminating (SIGTERM) 12:11:27.696486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6613): Terminating (SIGTERM) 12:11:27.738164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6616): Terminating (SIGTERM) 12:11:27.779691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6619): Terminating (SIGTERM) 12:11:27.821662 --- ParallelTerminationStrategy: PID 6607 died... 12:11:27.841551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6607): Terminated: ok {rc=0} 12:11:27.887926 --- ParallelTerminationStrategy: PID 6608 died... 12:11:27.907296 run iperf3-srv_10.42.42.10(pid=6608): Terminated {rc=256} 12:11:27.953296 --- ParallelTerminationStrategy: PID 6609 died... 12:11:27.972420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6609): Terminated: ok {rc=0} 12:11:28.018580 --- ParallelTerminationStrategy: PID 6610 died... 12:11:28.037927 run iperf3-srv_10.42.42.10(pid=6610): Terminated {rc=256} 12:11:28.083699 --- ParallelTerminationStrategy: PID 6613 died... 12:11:28.103116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6613): Terminated: ok {rc=0} 12:11:28.149114 --- ParallelTerminationStrategy: PID 6616 died... 12:11:28.168420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6616): Terminated: ok {rc=0} 12:11:28.214465 --- ParallelTerminationStrategy: PID 6619 died... 12:11:28.233888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6619): Terminated: ok {rc=0} 12:11:28.320915 bus /gobi_0: Setting Powered False 12:11:29.421224 bus /gobi_0: Setting Powered False 12:11:30.537056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 12:11:31.682954 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:31.694761 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:31.742254 tst iperf3.py: using LAC 28307 12:11:31.873229 tst iperf3.py: using RAC 2 12:11:32.008911 tst iperf3.py: using CellId 28307 12:11:32.143101 tst iperf3.py: using BVCI 28308 12:11:32.262760 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.274201 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.285276 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.296918 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.308522 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.319808 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.331312 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.342646 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:32.354415 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:32.469507 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:11:32.671063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:11:32.970745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Launched 12:11:33.232005 run iperf3-srv_10.42.42.10(pid=6622): Launched 12:11:33.344176 tst iperf3.py:8: start network... 12:11:33.544272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:34.007773 run create_hlr_db(pid=6623): Launched 12:11:34.130769 bus /gobi_6: Setting Powered False 12:11:35.191574 run create_hlr_db(pid=6623): Terminated: ok {rc=0} 12:11:35.630030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Launched 12:11:35.949575 run osmo-hlr_10.42.42.2(pid=6626): Launched 12:11:36.071832 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:36.627614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Launched 12:11:36.948916 run osmo-stp_10.42.42.5(pid=6629): Launched 12:11:37.071871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:11:37.623341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Launched 12:11:37.745840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:11:38.015862 run patchelf(pid=6632): Launched 12:11:38.194303 run osmo-stp_10.42.42.5(pid=6629): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] 12:11:38.330110 run osmo-stp_10.42.42.5(pid=6629): stdout: | (launched: 2022-12-10_12:11:36.890126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:38.467641 run osmo-stp_10.42.42.5(pid=6629): stderr: | 20221210121137084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121137084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121137084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121137085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121137085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121137085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121137085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:38.605875 run osmo-stp_10.42.42.5(pid=6629): stdout: | (launched: 2022-12-10_12:11:36.890126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:38.737196 run osmo-stp_10.42.42.5(pid=6629): stderr: | 20221210121137084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121137084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121137084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121137085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121137085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121137085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121137085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:38.893508 run patchelf(pid=6632): Terminating (SIGINT) 12:11:39.073459 run patchelf(pid=6632): Terminated: ok {rc=0} 12:11:39.203496 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6629): Process ended prematurely: osmo-stp_10.42.42.5(pid=6629) [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 12:11:39.213518 tst iperf3.py:8: Test FAILED (7.6 sec) 12:11:39.242288 run osmo-hlr_10.42.42.2(pid=6626): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6626)] 12:11:39.292419 run osmo-hlr_10.42.42.2(pid=6626): stdout: | (launched: 2022-12-10_12:11:35.891357) 12:11:39.343808 run osmo-hlr_10.42.42.2(pid=6626): stderr: | 20221210121136088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121136088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121136088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121136088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121136088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121136088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121136100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121136108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121136109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121136109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:39.395476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Terminating (SIGTERM) 12:11:39.436877 run iperf3-srv_10.42.42.10(pid=6622): Terminating (SIGTERM) 12:11:39.478486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Terminating (SIGTERM) 12:11:39.519792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Terminating (SIGTERM) 12:11:39.561406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Terminating (SIGTERM) 12:11:39.603580 --- ParallelTerminationStrategy: PID 6621 died... 12:11:39.623480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Terminated: ok {rc=0} 12:11:39.670246 --- ParallelTerminationStrategy: PID 6622 died... 12:11:39.689535 run iperf3-srv_10.42.42.10(pid=6622): Terminated {rc=256} 12:11:39.735909 --- ParallelTerminationStrategy: PID 6625 died... 12:11:39.755434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Terminated: ok {rc=0} 12:11:39.801749 --- ParallelTerminationStrategy: PID 6628 died... 12:11:39.821195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Terminated: ok {rc=0} 12:11:39.867570 --- ParallelTerminationStrategy: PID 6631 died... 12:11:39.887052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Terminated: ok {rc=0} 12:11:39.973955 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 12:11:41.120030 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.131589 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:41.176479 tst iperf3m4.py: using LAC 28308 12:11:41.306686 tst iperf3m4.py: using RAC 3 12:11:41.442628 tst iperf3m4.py: using CellId 28308 12:11:41.565695 tst iperf3m4.py: using BVCI 28309 12:11:41.682040 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.693432 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.704444 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.715825 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.727014 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.738285 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.750293 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.761613 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:11:41.772860 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:41.892017 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:42.009200 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:42.127416 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:11:42.249137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:11:42.466460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:11:42.787496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Launched 12:11:43.065256 run iperf3-srv_10.42.42.10(pid=6634): Launched 12:11:43.185771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:11:43.402920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:11:43.724815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6635): Launched 12:11:44.002381 run iperf3-srv_10.42.42.10(pid=6636): Launched 12:11:44.122544 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:11:44.339086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:11:44.660788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6637): Launched 12:11:44.939984 run iperf3-srv_10.42.42.10(pid=6638): Launched 12:11:45.060827 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:11:45.278400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:11:45.601090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6639): Launched 12:11:45.898396 run iperf3-srv_10.42.42.10(pid=6640): Launched 12:11:46.042789 tst iperf3m4.py:8: start network... 12:11:46.250533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:46.774535 run create_hlr_db(pid=6641): Launched 12:11:46.934587 bus /gobi_6: Setting Powered False 12:11:47.994714 run create_hlr_db(pid=6641): Terminated: ok {rc=0} 12:11:48.432687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6643): Launched 12:11:48.753267 run osmo-hlr_10.42.42.2(pid=6644): Launched 12:11:48.875739 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:49.533481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6646): Launched 12:11:49.847995 run osmo-stp_10.42.42.5(pid=6647): Launched 12:11:49.968640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:11:50.513405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6649): Launched 12:11:50.634122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:11:50.899968 run patchelf(pid=6650): Launched 12:11:51.075372 run osmo-stp_10.42.42.5(pid=6647): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6647)] 12:11:51.208938 run osmo-stp_10.42.42.5(pid=6647): stdout: | (launched: 2022-12-10_12:11:49.790760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:51.345162 run osmo-stp_10.42.42.5(pid=6647): stderr: | 20221210121149984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121149984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121149984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121149984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121149985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121149985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121149985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:51.480307 run osmo-stp_10.42.42.5(pid=6647): stdout: | (launched: 2022-12-10_12:11:49.790760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:51.609609 run osmo-stp_10.42.42.5(pid=6647): stderr: | 20221210121149984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121149984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121149984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121149984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121149985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121149985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121149985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:51.762883 run patchelf(pid=6650): Terminating (SIGINT) 12:11:51.939599 run patchelf(pid=6650): Terminated: ok {rc=0} 12:11:52.066940 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6647): Process ended prematurely: osmo-stp_10.42.42.5(pid=6647) [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6647)] [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 12:11:52.077128 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:11:52.106211 run osmo-hlr_10.42.42.2(pid=6644): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6644)] 12:11:52.156293 run osmo-hlr_10.42.42.2(pid=6644): stdout: | (launched: 2022-12-10_12:11:48.694731) 12:11:52.207729 run osmo-hlr_10.42.42.2(pid=6644): stderr: | 20221210121148894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121148894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121148894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121148894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121148894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121148894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121148905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121148914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121148914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121148914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:52.259435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Terminating (SIGTERM) 12:11:52.301169 run iperf3-srv_10.42.42.10(pid=6634): Terminating (SIGTERM) 12:11:52.342658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6635): Terminating (SIGTERM) 12:11:52.384303 run iperf3-srv_10.42.42.10(pid=6636): Terminating (SIGTERM) 12:11:52.425580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6637): Terminating (SIGTERM) 12:11:52.466967 run iperf3-srv_10.42.42.10(pid=6638): Terminating (SIGTERM) 12:11:52.508157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6639): Terminating (SIGTERM) 12:11:52.549456 run iperf3-srv_10.42.42.10(pid=6640): Terminating (SIGTERM) 12:11:52.590858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6643): Terminating (SIGTERM) 12:11:52.632116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6646): Terminating (SIGTERM) 12:11:52.673473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6649): Terminating (SIGTERM) 12:11:52.715182 --- ParallelTerminationStrategy: PID 6633 died... 12:11:52.735014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Terminated: ok {rc=0} 12:11:52.781269 --- ParallelTerminationStrategy: PID 6634 died... 12:11:52.800526 run iperf3-srv_10.42.42.10(pid=6634): Terminated {rc=256} 12:11:52.846479 --- ParallelTerminationStrategy: PID 6635 died... 12:11:52.865819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6635): Terminated: ok {rc=0} 12:11:52.911754 --- ParallelTerminationStrategy: PID 6636 died... 12:11:52.931074 run iperf3-srv_10.42.42.10(pid=6636): Terminated {rc=256} 12:11:52.977064 --- ParallelTerminationStrategy: PID 6637 died... 12:11:52.996403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6637): Terminated: ok {rc=0} 12:11:53.042379 --- ParallelTerminationStrategy: PID 6638 died... 12:11:53.061687 run iperf3-srv_10.42.42.10(pid=6638): Terminated {rc=256} 12:11:53.107687 --- ParallelTerminationStrategy: PID 6639 died... 12:11:53.126984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6639): Terminated: ok {rc=0} 12:11:53.172901 --- ParallelTerminationStrategy: PID 6640 died... 12:11:53.192270 run iperf3-srv_10.42.42.10(pid=6640): Terminated {rc=256} 12:11:53.238296 --- ParallelTerminationStrategy: PID 6643 died... 12:11:53.257840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6643): Terminated: ok {rc=0} 12:11:53.304076 --- ParallelTerminationStrategy: PID 6646 died... 12:11:53.323387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6646): Terminated: ok {rc=0} 12:11:53.369401 --- ParallelTerminationStrategy: PID 6649 died... 12:11:53.388578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6649): Terminated: ok {rc=0} 12:11:53.475484 bus /gobi_4: Setting Powered False 12:11:54.573946 bus /gobi_4: Setting Powered False 12:11:55.690233 bus /gobi_1: Setting Powered False 12:11:56.787526 bus /gobi_1: Setting Powered False 12:11:57.902672 bus /gobi_0: Setting Powered False 12:11:58.997066 bus /gobi_0: Setting Powered False 12:12:00.111174 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 12:12:01.216292 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.228922 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:12:01.277892 tst ping.py: using LAC 28309 12:12:01.440702 tst ping.py: using RAC 4 12:12:01.577593 tst ping.py: using CellId 28309 12:12:01.736046 tst ping.py: using BVCI 28310 12:12:01.858165 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.870241 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.883258 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.896224 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.908177 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.920877 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.934135 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:01.947338 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:12:02.084760 tst ping.py:19: start network... 12:12:02.306389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:02.788306 run create_hlr_db(pid=6651): Launched 12:12:02.906750 bus /gobi_6: Setting Powered False 12:12:03.968569 run create_hlr_db(pid=6651): Terminated: ok {rc=0} 12:12:04.384700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6653): Launched 12:12:04.677978 run osmo-hlr_10.42.42.2(pid=6654): Launched 12:12:04.789071 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:05.308553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6656): Launched 12:12:05.600922 run osmo-stp_10.42.42.5(pid=6657): Launched 12:12:05.712532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:12:06.213846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6659): Launched 12:12:06.324614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:12:06.568293 run patchelf(pid=6660): Launched 12:12:06.729188 run osmo-stp_10.42.42.5(pid=6657): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6657)] 12:12:06.851470 run osmo-stp_10.42.42.5(pid=6657): stdout: | (launched: 2022-12-10_12:12:05.547345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:06.975237 run osmo-stp_10.42.42.5(pid=6657): stderr: | 20221210121205719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121205719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121205720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121205720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121205720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121205721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121205721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:07.099077 run osmo-stp_10.42.42.5(pid=6657): stdout: | (launched: 2022-12-10_12:12:05.547345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:07.217242 run osmo-stp_10.42.42.5(pid=6657): stderr: | 20221210121205719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121205719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121205720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121205720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121205720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121205721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121205721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:07.357269 run patchelf(pid=6660): Terminating (SIGINT) 12:12:07.520238 run patchelf(pid=6660): Terminated: ok {rc=0} 12:12:07.636826 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6657): Process ended prematurely: osmo-stp_10.42.42.5(pid=6657) [trial-2374↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6657)] [trial-2374↪gprs:trx-lms-limenet-micro↪ping.py:22] 12:12:07.645613 tst ping.py:22: Test FAILED (6.4 sec) 12:12:07.671755 run osmo-hlr_10.42.42.2(pid=6654): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6654)] 12:12:07.718527 run osmo-hlr_10.42.42.2(pid=6654): stdout: | (launched: 2022-12-10_12:12:04.624547) 12:12:07.766986 run osmo-hlr_10.42.42.2(pid=6654): stderr: | 20221210121204798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121204798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121204799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121204799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121204799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121204799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121204811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121204820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121204820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121204820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:07.815964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6653): Terminating (SIGTERM) 12:12:07.855161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6656): Terminating (SIGTERM) 12:12:07.894182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6659): Terminating (SIGTERM) 12:12:07.933492 --- ParallelTerminationStrategy: PID 6653 died... 12:12:07.952063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6653): Terminated: ok {rc=0} 12:12:07.995266 --- ParallelTerminationStrategy: PID 6656 died... 12:12:08.013555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6656): Terminated: ok {rc=0} 12:12:08.056622 --- ParallelTerminationStrategy: PID 6659 died... 12:12:08.074892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6659): Terminated: ok {rc=0} 12:12:08.159449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 12:12:09.247937 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.259526 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:12:09.305271 tst ping_idle_ping.py: using LAC 28310 12:12:09.420249 tst ping_idle_ping.py: using RAC 5 12:12:09.543867 tst ping_idle_ping.py: using CellId 28310 12:12:09.666353 tst ping_idle_ping.py: using BVCI 28311 12:12:09.779550 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.790853 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.802019 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.813518 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.824831 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.835955 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.847422 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:12:09.858727 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:12:09.972472 tst ping_idle_ping.py:24: start network... 12:12:10.167206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:10.620671 run create_hlr_db(pid=6661): Launched 12:12:10.742124 bus /gobi_6: Setting Powered False 12:12:11.800735 run create_hlr_db(pid=6661): Terminated: ok {rc=0} 12:12:12.228004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6663): Launched 12:12:12.540170 run osmo-hlr_10.42.42.2(pid=6664): Launched 12:12:12.660673 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:13.202076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6666): Launched 12:12:13.499828 run osmo-stp_10.42.42.5(pid=6667): Launched 12:12:13.612156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:12:14.114299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6669): Launched 12:12:14.225907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:12:14.471062 run patchelf(pid=6670): Launched 12:12:14.632914 run osmo-stp_10.42.42.5(pid=6667): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6667)] 12:12:14.756092 run osmo-stp_10.42.42.5(pid=6667): stdout: | (launched: 2022-12-10_12:12:13.446209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:14.881555 run osmo-stp_10.42.42.5(pid=6667): stderr: | 20221210121213617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121213617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121213617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121213618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121213618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121213618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121213618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:15.006589 run osmo-stp_10.42.42.5(pid=6667): stdout: | (launched: 2022-12-10_12:12:13.446209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:15.126372 run osmo-stp_10.42.42.5(pid=6667): stderr: | 20221210121213617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121213617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121213617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121213618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121213618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121213618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121213618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:15.267614 run patchelf(pid=6670): Terminating (SIGINT) 12:12:15.430632 run patchelf(pid=6670): Terminated: ok {rc=0} 12:12:15.548577 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6667): Process ended prematurely: osmo-stp_10.42.42.5(pid=6667) [trial-2374↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6667)] [trial-2374↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 12:12:15.557365 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 12:12:15.583392 run osmo-hlr_10.42.42.2(pid=6664): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6664)] 12:12:15.630432 run osmo-hlr_10.42.42.2(pid=6664): stdout: | (launched: 2022-12-10_12:12:12.483438) 12:12:15.678408 run osmo-hlr_10.42.42.2(pid=6664): stderr: | 20221210121212682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121212683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121212683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121212683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121212683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121212683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121212695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121212705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121212705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121212705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:15.726923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6663): Terminating (SIGTERM) 12:12:15.765699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6666): Terminating (SIGTERM) 12:12:15.804535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6669): Terminating (SIGTERM) 12:12:15.859636 --- ParallelTerminationStrategy: PID 6663 died... 12:12:15.884600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6663): Terminated: ok {rc=0} 12:12:15.928877 --- ParallelTerminationStrategy: PID 6666 died... 12:12:15.947607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6666): Terminated: ok {rc=0} 12:12:15.991557 --- ParallelTerminationStrategy: PID 6669 died... 12:12:16.010933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6669): Terminated: ok {rc=0} 12:12:16.096016 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 12:12:17.394826 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:17.400910 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:12:17.429363 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:12:17.466834 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:12:17.551995 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:12:17.580289 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:12:17.617738 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:12:18.212378 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:12:18.259603 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.270465 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:12:18.316333 tst cs_paging_gprs_active.py: using LAC 28311 12:12:18.434437 tst cs_paging_gprs_active.py: using RAC 6 12:12:18.555459 tst cs_paging_gprs_active.py: using CellId 28311 12:12:18.671472 tst cs_paging_gprs_active.py: using BVCI 28312 12:12:18.778513 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.789420 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.800056 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.810674 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.821284 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.831939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.842659 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.853177 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:18.863836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:12:18.980161 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:12:19.095773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:12:19.311275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:19.629783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6674): Launched 12:12:19.905910 run iperf3-srv_10.42.42.10(pid=6675): Launched 12:12:20.024472 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:12:20.237612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:20.555357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6676): Launched 12:12:20.830955 run iperf3-srv_10.42.42.10(pid=6677): Launched 12:12:20.949709 tst cs_paging_gprs_active.py:38: start network... 12:12:21.163457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:21.653250 run create_hlr_db(pid=6678): Launched 12:12:21.774281 bus /gobi_6: Setting Powered False 12:12:22.837343 run create_hlr_db(pid=6678): Terminated: ok {rc=0} 12:12:23.260665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6680): Launched 12:12:23.579076 run osmo-hlr_10.42.42.2(pid=6681): Launched 12:12:23.700473 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:24.242157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6683): Launched 12:12:24.558713 run osmo-stp_10.42.42.5(pid=6684): Launched 12:12:24.679231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:12:25.224885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6686): Launched 12:12:25.347036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:12:25.614362 run patchelf(pid=6687): Launched 12:12:25.790831 run osmo-stp_10.42.42.5(pid=6684): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6684)] 12:12:25.925320 run osmo-stp_10.42.42.5(pid=6684): stdout: | (launched: 2022-12-10_12:12:24.501566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:26.061647 run osmo-stp_10.42.42.5(pid=6684): stderr: | 20221210121224695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121224695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121224695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121224696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121224696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121224696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121224696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:26.197575 run osmo-stp_10.42.42.5(pid=6684): stdout: | (launched: 2022-12-10_12:12:24.501566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:26.328348 run osmo-stp_10.42.42.5(pid=6684): stderr: | 20221210121224695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121224695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121224695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121224696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121224696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121224696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121224696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:26.482842 run patchelf(pid=6687): Terminating (SIGINT) 12:12:26.660060 run patchelf(pid=6687): Terminated: ok {rc=0} 12:12:26.788204 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6684): Process ended prematurely: osmo-stp_10.42.42.5(pid=6684) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6684)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:12:26.798226 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:12:26.826824 run osmo-hlr_10.42.42.2(pid=6681): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6681)] 12:12:26.876328 run osmo-hlr_10.42.42.2(pid=6681): stdout: | (launched: 2022-12-10_12:12:23.521532) 12:12:26.927700 run osmo-hlr_10.42.42.2(pid=6681): stderr: | 20221210121223719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121223719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121223719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121223719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121223719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121223719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121223743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121223753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121223753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121223754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:26.979599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6674): Terminating (SIGTERM) 12:12:27.021363 run iperf3-srv_10.42.42.10(pid=6675): Terminating (SIGTERM) 12:12:27.062809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6676): Terminating (SIGTERM) 12:12:27.104465 run iperf3-srv_10.42.42.10(pid=6677): Terminating (SIGTERM) 12:12:27.145993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6680): Terminating (SIGTERM) 12:12:27.187596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6683): Terminating (SIGTERM) 12:12:27.229227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6686): Terminating (SIGTERM) 12:12:27.271019 --- ParallelTerminationStrategy: PID 6674 died... 12:12:27.290701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6674): Terminated: ok {rc=0} 12:12:27.337344 --- ParallelTerminationStrategy: PID 6675 died... 12:12:27.356493 run iperf3-srv_10.42.42.10(pid=6675): Terminated {rc=256} 12:12:27.402491 --- ParallelTerminationStrategy: PID 6676 died... 12:12:27.421924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6676): Terminated: ok {rc=0} 12:12:27.467774 --- ParallelTerminationStrategy: PID 6677 died... 12:12:27.486978 run iperf3-srv_10.42.42.10(pid=6677): Terminated {rc=256} 12:12:27.532775 --- ParallelTerminationStrategy: PID 6680 died... 12:12:27.551961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6680): Terminated: ok {rc=0} 12:12:27.597688 --- ParallelTerminationStrategy: PID 6683 died... 12:12:27.617047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6683): Terminated: ok {rc=0} 12:12:27.662978 --- ParallelTerminationStrategy: PID 6686 died... 12:12:27.682349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6686): Terminated: ok {rc=0} 12:12:27.770190 bus /gobi_0: Setting Powered False 12:12:28.866987 bus /gobi_0: Setting Powered False 12:12:29.981269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:12:31.159706 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.175912 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:12:31.237258 tst iperf3.py: using LAC 28312 12:12:31.359063 tst iperf3.py: using RAC 7 12:12:31.510906 tst iperf3.py: using CellId 28312 12:12:31.638639 tst iperf3.py: using BVCI 28313 12:12:31.793060 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.808692 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.825002 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.841844 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.856237 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.872085 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.889025 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.905384 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:31.918316 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:12:32.036159 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:12:32.266872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:32.586118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6688): Launched 12:12:32.861130 run iperf3-srv_10.42.42.10(pid=6689): Launched 12:12:32.979978 tst iperf3.py:8: start network... 12:12:33.193527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:33.682797 run create_hlr_db(pid=6690): Launched 12:12:33.805697 bus /gobi_6: Setting Powered False 12:12:34.868555 run create_hlr_db(pid=6690): Terminated: ok {rc=0} 12:12:35.293044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6692): Launched 12:12:35.588711 run osmo-hlr_10.42.42.2(pid=6693): Launched 12:12:35.704367 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:36.244186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6697): Launched 12:12:36.559889 run osmo-stp_10.42.42.5(pid=6698): Launched 12:12:36.681607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:12:37.224437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6700): Launched 12:12:37.345483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:12:37.612611 run patchelf(pid=6701): Launched 12:12:37.788567 run osmo-stp_10.42.42.5(pid=6698): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6698)] 12:12:37.922476 run osmo-stp_10.42.42.5(pid=6698): stdout: | (launched: 2022-12-10_12:12:36.502779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:38.058045 run osmo-stp_10.42.42.5(pid=6698): stderr: | 20221210121236693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121236694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121236694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121236694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121236696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121236697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121236697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:38.193612 run osmo-stp_10.42.42.5(pid=6698): stdout: | (launched: 2022-12-10_12:12:36.502779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:38.323349 run osmo-stp_10.42.42.5(pid=6698): stderr: | 20221210121236693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121236694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121236694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121236694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121236696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121236697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121236697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:38.476686 run patchelf(pid=6701): Terminating (SIGINT) 12:12:38.653438 run patchelf(pid=6701): Terminated: ok {rc=0} 12:12:38.781471 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6698): Process ended prematurely: osmo-stp_10.42.42.5(pid=6698) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6698)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 12:12:38.791377 tst iperf3.py:8: Test FAILED (7.7 sec) 12:12:38.819898 run osmo-hlr_10.42.42.2(pid=6693): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6693)] 12:12:38.870473 run osmo-hlr_10.42.42.2(pid=6693): stdout: | (launched: 2022-12-10_12:12:35.534698) 12:12:38.922428 run osmo-hlr_10.42.42.2(pid=6693): stderr: | 20221210121235707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121235707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121235707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121235707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121235707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121235707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121235718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121235726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121235726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121235726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:38.974856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6688): Terminating (SIGTERM) 12:12:39.017088 run iperf3-srv_10.42.42.10(pid=6689): Terminating (SIGTERM) 12:12:39.058805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6692): Terminating (SIGTERM) 12:12:39.100691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6697): Terminating (SIGTERM) 12:12:39.142334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6700): Terminating (SIGTERM) 12:12:39.184095 --- ParallelTerminationStrategy: PID 6688 died... 12:12:39.204157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6688): Terminated: ok {rc=0} 12:12:39.250818 --- ParallelTerminationStrategy: PID 6689 died... 12:12:39.270057 run iperf3-srv_10.42.42.10(pid=6689): Terminated {rc=256} 12:12:39.316038 --- ParallelTerminationStrategy: PID 6692 died... 12:12:39.335634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6692): Terminated: ok {rc=0} 12:12:39.381662 --- ParallelTerminationStrategy: PID 6697 died... 12:12:39.400858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6697): Terminated: ok {rc=0} 12:12:39.447122 --- ParallelTerminationStrategy: PID 6700 died... 12:12:39.466460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6700): Terminated: ok {rc=0} 12:12:39.553471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:12:40.701560 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:40.713683 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:12:40.762540 tst iperf3m4.py: using LAC 28313 12:12:40.885395 tst iperf3m4.py: using RAC 8 12:12:41.010907 tst iperf3m4.py: using CellId 28313 12:12:41.136351 tst iperf3m4.py: using BVCI 28314 12:12:41.250859 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.262321 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.273470 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.284674 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.295945 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.307231 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.318686 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.330332 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:12:41.341952 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:12:41.463139 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:12:41.576035 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:12:41.689442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:12:41.804374 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:12:42.002423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:42.297234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6702): Launched 12:12:42.554880 run iperf3-srv_10.42.42.10(pid=6703): Launched 12:12:42.665608 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:12:42.863317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:43.158200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6704): Launched 12:12:43.415241 run iperf3-srv_10.42.42.10(pid=6705): Launched 12:12:43.525925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:12:43.723993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:44.019261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6706): Launched 12:12:44.275823 run iperf3-srv_10.42.42.10(pid=6707): Launched 12:12:44.386470 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:12:44.583101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:44.878350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6708): Launched 12:12:45.134802 run iperf3-srv_10.42.42.10(pid=6709): Launched 12:12:45.245415 tst iperf3m4.py:8: start network... 12:12:45.442090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:45.937724 run create_hlr_db(pid=6710): Launched 12:12:46.104694 bus /gobi_6: Setting Powered False 12:12:47.166120 run create_hlr_db(pid=6710): Terminated: ok {rc=0} 12:12:47.611404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6712): Launched 12:12:47.928702 run osmo-hlr_10.42.42.2(pid=6713): Launched 12:12:48.050106 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:48.599380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6715): Launched 12:12:48.914483 run osmo-stp_10.42.42.5(pid=6716): Launched 12:12:49.035275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:12:49.580615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6718): Launched 12:12:49.701706 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:12:49.969089 run patchelf(pid=6719): Launched 12:12:50.145084 run osmo-stp_10.42.42.5(pid=6716): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6716)] 12:12:50.278818 run osmo-stp_10.42.42.5(pid=6716): stdout: | (launched: 2022-12-10_12:12:48.857271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:50.415283 run osmo-stp_10.42.42.5(pid=6716): stderr: | 20221210121249049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121249049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121249049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121249050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121249050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121249050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121249050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:50.550689 run osmo-stp_10.42.42.5(pid=6716): stdout: | (launched: 2022-12-10_12:12:48.857271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:50.680790 run osmo-stp_10.42.42.5(pid=6716): stderr: | 20221210121249049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121249049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121249049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121249050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121249050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121249050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121249050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:50.834490 run patchelf(pid=6719): Terminating (SIGINT) 12:12:51.011258 run patchelf(pid=6719): Terminated: ok {rc=0} 12:12:51.138547 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6716): Process ended prematurely: osmo-stp_10.42.42.5(pid=6716) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6716)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 12:12:51.148603 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:12:51.177535 run osmo-hlr_10.42.42.2(pid=6713): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6713)] 12:12:51.226963 run osmo-hlr_10.42.42.2(pid=6713): stdout: | (launched: 2022-12-10_12:12:47.871468) 12:12:51.278207 run osmo-hlr_10.42.42.2(pid=6713): stderr: | 20221210121248070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121248070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121248070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121248070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121248070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121248070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121248082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121248090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121248091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121248091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:51.330270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6702): Terminating (SIGTERM) 12:12:51.372053 run iperf3-srv_10.42.42.10(pid=6703): Terminating (SIGTERM) 12:12:51.413618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6704): Terminating (SIGTERM) 12:12:51.455110 run iperf3-srv_10.42.42.10(pid=6705): Terminating (SIGTERM) 12:12:51.496326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6706): Terminating (SIGTERM) 12:12:51.537793 run iperf3-srv_10.42.42.10(pid=6707): Terminating (SIGTERM) 12:12:51.579038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6708): Terminating (SIGTERM) 12:12:51.620527 run iperf3-srv_10.42.42.10(pid=6709): Terminating (SIGTERM) 12:12:51.662227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6712): Terminating (SIGTERM) 12:12:51.703629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6715): Terminating (SIGTERM) 12:12:51.745163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6718): Terminating (SIGTERM) 12:12:51.787946 --- ParallelTerminationStrategy: PID 6702 died... 12:12:51.807745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6702): Terminated: ok {rc=0} 12:12:51.854752 --- ParallelTerminationStrategy: PID 6703 died... 12:12:51.873986 run iperf3-srv_10.42.42.10(pid=6703): Terminated {rc=256} 12:12:51.946623 --- ParallelTerminationStrategy: PID 6704 died... 12:12:51.965056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6704): Terminated: ok {rc=0} 12:12:52.008197 --- ParallelTerminationStrategy: PID 6705 died... 12:12:52.026223 run iperf3-srv_10.42.42.10(pid=6705): Terminated {rc=256} 12:12:52.069149 --- ParallelTerminationStrategy: PID 6706 died... 12:12:52.087327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6706): Terminated: ok {rc=0} 12:12:52.130804 --- ParallelTerminationStrategy: PID 6707 died... 12:12:52.149002 run iperf3-srv_10.42.42.10(pid=6707): Terminated {rc=256} 12:12:52.191703 --- ParallelTerminationStrategy: PID 6708 died... 12:12:52.209978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6708): Terminated: ok {rc=0} 12:12:52.252932 --- ParallelTerminationStrategy: PID 6709 died... 12:12:52.271114 run iperf3-srv_10.42.42.10(pid=6709): Terminated {rc=256} 12:12:52.313768 --- ParallelTerminationStrategy: PID 6712 died... 12:12:52.331998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6712): Terminated: ok {rc=0} 12:12:52.375345 --- ParallelTerminationStrategy: PID 6715 died... 12:12:52.393804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6715): Terminated: ok {rc=0} 12:12:52.437313 --- ParallelTerminationStrategy: PID 6718 died... 12:12:52.455934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6718): Terminated: ok {rc=0} 12:12:52.540503 bus /gobi_4: Setting Powered False 12:12:53.638565 bus /gobi_4: Setting Powered False 12:12:54.757376 bus /gobi_1: Setting Powered False 12:12:55.855741 bus /gobi_1: Setting Powered False 12:12:56.970412 bus /gobi_0: Setting Powered False 12:12:58.067134 bus /gobi_0: Setting Powered False 12:12:59.183375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 12:13:00.283358 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.294837 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:13:00.341498 tst ping.py: using LAC 28314 12:13:00.464798 tst ping.py: using RAC 9 12:13:00.588264 tst ping.py: using CellId 28314 12:13:00.709622 tst ping.py: using BVCI 28315 12:13:00.825069 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.837269 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.849101 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.864070 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.882055 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.894211 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.908311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:00.920654 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:13:01.047212 tst ping.py:19: start network... 12:13:01.261409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:01.757568 run create_hlr_db(pid=6720): Launched 12:13:01.913842 bus /gobi_6: Setting Powered False 12:13:02.975354 run create_hlr_db(pid=6720): Terminated: ok {rc=0} 12:13:03.392559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6722): Launched 12:13:03.682850 run osmo-hlr_10.42.42.2(pid=6723): Launched 12:13:03.793520 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:04.294696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6725): Launched 12:13:04.584678 run osmo-stp_10.42.42.5(pid=6726): Launched 12:13:04.694623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:05.197580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6728): Launched 12:13:05.309357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:05.554149 run patchelf(pid=6729): Launched 12:13:05.715517 run osmo-stp_10.42.42.5(pid=6726): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6726)] 12:13:05.838695 run osmo-stp_10.42.42.5(pid=6726): stdout: | (launched: 2022-12-10_12:13:04.530937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:05.966844 run osmo-stp_10.42.42.5(pid=6726): stderr: | 20221210121304703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121304703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121304703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121304704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121304704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121304704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121304704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:06.091842 run osmo-stp_10.42.42.5(pid=6726): stdout: | (launched: 2022-12-10_12:13:04.530937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:06.211075 run osmo-stp_10.42.42.5(pid=6726): stderr: | 20221210121304703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121304703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121304703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121304704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121304704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121304704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121304704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:06.353170 run patchelf(pid=6729): Terminating (SIGINT) 12:13:06.516450 run patchelf(pid=6729): Terminated: ok {rc=0} 12:13:06.634185 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6726): Process ended prematurely: osmo-stp_10.42.42.5(pid=6726) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6726)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 12:13:06.642940 tst ping.py:22: Test FAILED (6.4 sec) 12:13:06.669313 run osmo-hlr_10.42.42.2(pid=6723): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6723)] 12:13:06.716436 run osmo-hlr_10.42.42.2(pid=6723): stdout: | (launched: 2022-12-10_12:13:03.629694) 12:13:06.765289 run osmo-hlr_10.42.42.2(pid=6723): stderr: | 20221210121303804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121303805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121303805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121303805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121303805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121303805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121303817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121303825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121303826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121303826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:06.814518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6722): Terminating (SIGTERM) 12:13:06.854184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6725): Terminating (SIGTERM) 12:13:06.893837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6728): Terminating (SIGTERM) 12:13:06.933952 --- ParallelTerminationStrategy: PID 6722 died... 12:13:06.953039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6722): Terminated: ok {rc=0} 12:13:06.997895 --- ParallelTerminationStrategy: PID 6725 died... 12:13:07.016485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6725): Terminated: ok {rc=0} 12:13:07.060806 --- ParallelTerminationStrategy: PID 6728 died... 12:13:07.079860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6728): Terminated: ok {rc=0} 12:13:07.166290 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:13:08.256268 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.268350 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:13:08.316436 tst ping_idle_ping.py: using LAC 28315 12:13:08.431883 tst ping_idle_ping.py: using RAC 10 12:13:08.555607 tst ping_idle_ping.py: using CellId 28315 12:13:08.680352 tst ping_idle_ping.py: using BVCI 28316 12:13:08.794142 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.805698 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.817050 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.829231 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.841447 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.853372 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.865930 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:08.877679 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:13:08.993523 tst ping_idle_ping.py:24: start network... 12:13:09.188811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:09.642868 run create_hlr_db(pid=6730): Launched 12:13:09.763973 bus /gobi_6: Setting Powered False 12:13:10.823103 run create_hlr_db(pid=6730): Terminated: ok {rc=0} 12:13:11.229779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6732): Launched 12:13:11.521294 run osmo-hlr_10.42.42.2(pid=6733): Launched 12:13:11.631869 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:12.145707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6735): Launched 12:13:12.435464 run osmo-stp_10.42.42.5(pid=6736): Launched 12:13:12.546880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:13.048679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6738): Launched 12:13:13.159917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:13.405247 run patchelf(pid=6739): Launched 12:13:13.567116 run osmo-stp_10.42.42.5(pid=6736): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6736)] 12:13:13.690160 run osmo-stp_10.42.42.5(pid=6736): stdout: | (launched: 2022-12-10_12:13:12.382393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:13.814678 run osmo-stp_10.42.42.5(pid=6736): stderr: | 20221210121312550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121312550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121312550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121312551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121312551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121312551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121312551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:13.940206 run osmo-stp_10.42.42.5(pid=6736): stdout: | (launched: 2022-12-10_12:13:12.382393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:14.059197 run osmo-stp_10.42.42.5(pid=6736): stderr: | 20221210121312550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121312550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121312550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121312551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121312551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121312551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121312551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:14.200685 run patchelf(pid=6739): Terminating (SIGINT) 12:13:14.363373 run patchelf(pid=6739): Terminated: ok {rc=0} 12:13:14.480564 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6736): Process ended prematurely: osmo-stp_10.42.42.5(pid=6736) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6736)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 12:13:14.489610 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 12:13:14.515751 run osmo-hlr_10.42.42.2(pid=6733): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6733)] 12:13:14.562993 run osmo-hlr_10.42.42.2(pid=6733): stdout: | (launched: 2022-12-10_12:13:11.467812) 12:13:14.611328 run osmo-hlr_10.42.42.2(pid=6733): stderr: | 20221210121311641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121311641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121311641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121311641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121311641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121311641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121311654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121311664 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121311664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121311664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:14.660360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6732): Terminating (SIGTERM) 12:13:14.699746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6735): Terminating (SIGTERM) 12:13:14.738762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6738): Terminating (SIGTERM) 12:13:14.778288 --- ParallelTerminationStrategy: PID 6732 died... 12:13:14.797032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6732): Terminated: ok {rc=0} 12:13:14.840380 --- ParallelTerminationStrategy: PID 6735 died... 12:13:14.858910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6735): Terminated: ok {rc=0} 12:13:14.902151 --- ParallelTerminationStrategy: PID 6738 died... 12:13:14.920496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6738): Terminated: ok {rc=0} 12:13:15.003371 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:13:16.307851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:16.315472 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:13:16.355866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:13:16.407652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:13:16.518960 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:13:16.559289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:13:16.610956 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:13:17.198605 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:13:17.249286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.260721 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:13:17.325322 tst cs_paging_gprs_active.py: using LAC 28316 12:13:17.440806 tst cs_paging_gprs_active.py: using RAC 11 12:13:17.557547 tst cs_paging_gprs_active.py: using CellId 28316 12:13:17.673650 tst cs_paging_gprs_active.py: using BVCI 28317 12:13:17.783099 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.794209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.805111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.815882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.826786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.837595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.848423 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.859004 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:17.870115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:13:17.987449 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:13:18.103226 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:13:18.302455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:18.599558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6743): Launched 12:13:18.857570 run iperf3-srv_10.42.42.10(pid=6744): Launched 12:13:18.968580 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:13:19.166714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:19.463726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6745): Launched 12:13:19.721496 run iperf3-srv_10.42.42.10(pid=6746): Launched 12:13:19.832590 tst cs_paging_gprs_active.py:38: start network... 12:13:20.031802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:20.490699 run create_hlr_db(pid=6747): Launched 12:13:20.611771 bus /gobi_6: Setting Powered False 12:13:21.671161 run create_hlr_db(pid=6747): Terminated: ok {rc=0} 12:13:22.105346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6749): Launched 12:13:22.423265 run osmo-hlr_10.42.42.2(pid=6750): Launched 12:13:22.545439 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:23.092866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6752): Launched 12:13:23.409763 run osmo-stp_10.42.42.5(pid=6753): Launched 12:13:23.531271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:24.081975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6755): Launched 12:13:24.203324 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:24.471230 run patchelf(pid=6756): Launched 12:13:24.648622 run osmo-stp_10.42.42.5(pid=6753): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6753)] 12:13:24.783509 run osmo-stp_10.42.42.5(pid=6753): stdout: | (launched: 2022-12-10_12:13:23.352249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:24.919682 run osmo-stp_10.42.42.5(pid=6753): stderr: | 20221210121323541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121323541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121323541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121323542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121323542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121323542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121323542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:25.056041 run osmo-stp_10.42.42.5(pid=6753): stdout: | (launched: 2022-12-10_12:13:23.352249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:25.186604 run osmo-stp_10.42.42.5(pid=6753): stderr: | 20221210121323541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121323541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121323541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121323542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121323542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121323542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121323542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:25.340659 run patchelf(pid=6756): Terminating (SIGINT) 12:13:25.518944 run patchelf(pid=6756): Terminated: ok {rc=0} 12:13:25.647352 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6753): Process ended prematurely: osmo-stp_10.42.42.5(pid=6753) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6753)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:13:25.657261 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 12:13:25.686080 run osmo-hlr_10.42.42.2(pid=6750): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6750)] 12:13:25.735977 run osmo-hlr_10.42.42.2(pid=6750): stdout: | (launched: 2022-12-10_12:13:22.365663) 12:13:25.787707 run osmo-hlr_10.42.42.2(pid=6750): stderr: | 20221210121322563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121322563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121322563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121322563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121322563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121322563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121322576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121322584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121322584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121322584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:25.839611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6743): Terminating (SIGTERM) 12:13:25.881109 run iperf3-srv_10.42.42.10(pid=6744): Terminating (SIGTERM) 12:13:25.922276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6745): Terminating (SIGTERM) 12:13:25.964139 run iperf3-srv_10.42.42.10(pid=6746): Terminating (SIGTERM) 12:13:26.005843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6749): Terminating (SIGTERM) 12:13:26.047588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6752): Terminating (SIGTERM) 12:13:26.089113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6755): Terminating (SIGTERM) 12:13:26.130855 --- ParallelTerminationStrategy: PID 6743 died... 12:13:26.150580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6743): Terminated: ok {rc=0} 12:13:26.196828 --- ParallelTerminationStrategy: PID 6744 died... 12:13:26.216483 run iperf3-srv_10.42.42.10(pid=6744): Terminated {rc=256} 12:13:26.262326 --- ParallelTerminationStrategy: PID 6745 died... 12:13:26.281590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6745): Terminated: ok {rc=0} 12:13:26.327303 --- ParallelTerminationStrategy: PID 6746 died... 12:13:26.346867 run iperf3-srv_10.42.42.10(pid=6746): Terminated {rc=256} 12:13:26.392423 --- ParallelTerminationStrategy: PID 6749 died... 12:13:26.411802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6749): Terminated: ok {rc=0} 12:13:26.457464 --- ParallelTerminationStrategy: PID 6752 died... 12:13:26.477187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6752): Terminated: ok {rc=0} 12:13:26.523668 --- ParallelTerminationStrategy: PID 6755 died... 12:13:26.543051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6755): Terminated: ok {rc=0} 12:13:26.629810 bus /gobi_0: Setting Powered False 12:13:27.728179 bus /gobi_0: Setting Powered False 12:13:28.843620 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:13:29.991816 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.003801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:13:30.073083 tst iperf3.py: using LAC 28317 12:13:30.198945 tst iperf3.py: using RAC 12 12:13:30.324189 tst iperf3.py: using CellId 28317 12:13:30.443142 tst iperf3.py: using BVCI 28318 12:13:30.550926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.562132 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.573093 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.584618 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.596124 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.607477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.618737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.629804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:30.641195 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:13:30.758397 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:13:30.981228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:31.318466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6757): Launched 12:13:31.610437 run iperf3-srv_10.42.42.10(pid=6758): Launched 12:13:31.745467 tst iperf3.py:8: start network... 12:13:31.965056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:32.461677 run create_hlr_db(pid=6759): Launched 12:13:32.583620 bus /gobi_6: Setting Powered False 12:13:33.647308 run create_hlr_db(pid=6759): Terminated: ok {rc=0} 12:13:34.071198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6761): Launched 12:13:34.368290 run osmo-hlr_10.42.42.2(pid=6762): Launched 12:13:34.480860 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:34.995884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6765): Launched 12:13:35.291055 run osmo-stp_10.42.42.5(pid=6766): Launched 12:13:35.403236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:35.912290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6768): Launched 12:13:36.026215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:36.277155 run patchelf(pid=6769): Launched 12:13:36.441974 run osmo-stp_10.42.42.5(pid=6766): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6766)] 12:13:36.566903 run osmo-stp_10.42.42.5(pid=6766): stdout: | (launched: 2022-12-10_12:13:35.237138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:36.694464 run osmo-stp_10.42.42.5(pid=6766): stderr: | 20221210121335406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121335406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121335407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121335407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121335408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121335408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121335408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:36.821586 run osmo-stp_10.42.42.5(pid=6766): stdout: | (launched: 2022-12-10_12:13:35.237138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:36.942868 run osmo-stp_10.42.42.5(pid=6766): stderr: | 20221210121335406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121335406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121335407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121335407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121335408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121335408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121335408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:37.086619 run patchelf(pid=6769): Terminating (SIGINT) 12:13:37.253268 run patchelf(pid=6769): Terminated: ok {rc=0} 12:13:37.372854 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6766): Process ended prematurely: osmo-stp_10.42.42.5(pid=6766) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6766)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 12:13:37.382316 tst iperf3.py:8: Test FAILED (7.4 sec) 12:13:37.409245 run osmo-hlr_10.42.42.2(pid=6762): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6762)] 12:13:37.456372 run osmo-hlr_10.42.42.2(pid=6762): stdout: | (launched: 2022-12-10_12:13:34.313813) 12:13:37.505366 run osmo-hlr_10.42.42.2(pid=6762): stderr: | 20221210121334487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121334487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121334487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121334487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121334487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121334487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121334502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121334513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121334513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121334513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:37.554541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6757): Terminating (SIGTERM) 12:13:37.593942 run iperf3-srv_10.42.42.10(pid=6758): Terminating (SIGTERM) 12:13:37.633156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6761): Terminating (SIGTERM) 12:13:37.672253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6765): Terminating (SIGTERM) 12:13:37.711440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6768): Terminating (SIGTERM) 12:13:37.751251 --- ParallelTerminationStrategy: PID 6757 died... 12:13:37.770312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6757): Terminated: ok {rc=0} 12:13:37.814135 --- ParallelTerminationStrategy: PID 6758 died... 12:13:37.832345 run iperf3-srv_10.42.42.10(pid=6758): Terminated {rc=256} 12:13:37.876176 --- ParallelTerminationStrategy: PID 6761 died... 12:13:37.894622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6761): Terminated: ok {rc=0} 12:13:37.937763 --- ParallelTerminationStrategy: PID 6765 died... 12:13:37.956044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6765): Terminated: ok {rc=0} 12:13:37.999436 --- ParallelTerminationStrategy: PID 6768 died... 12:13:38.017815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6768): Terminated: ok {rc=0} 12:13:38.100909 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:13:39.249991 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.262137 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:13:39.331399 tst iperf3m4.py: using LAC 28318 12:13:39.457511 tst iperf3m4.py: using RAC 13 12:13:39.577143 tst iperf3m4.py: using CellId 28318 12:13:39.693437 tst iperf3m4.py: using BVCI 28319 12:13:39.811599 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.823251 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.834649 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.846947 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.859377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.871140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.883194 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.894975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:39.907085 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:13:40.027075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:13:40.146291 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:13:40.262152 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:13:40.380801 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:13:40.597072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:40.915925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6770): Launched 12:13:41.193228 run iperf3-srv_10.42.42.10(pid=6771): Launched 12:13:41.313189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:13:41.528608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:41.850813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6772): Launched 12:13:42.127829 run iperf3-srv_10.42.42.10(pid=6773): Launched 12:13:42.247285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:13:42.462013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:42.780583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6774): Launched 12:13:43.055758 run iperf3-srv_10.42.42.10(pid=6775): Launched 12:13:43.174800 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:13:43.388663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:43.707301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6776): Launched 12:13:43.984154 run iperf3-srv_10.42.42.10(pid=6777): Launched 12:13:44.103488 tst iperf3m4.py:8: start network... 12:13:44.318096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:44.811383 run create_hlr_db(pid=6778): Launched 12:13:44.931727 bus /gobi_6: Setting Powered False 12:13:46.001806 run create_hlr_db(pid=6778): Terminated: ok {rc=0} 12:13:46.465779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6780): Launched 12:13:46.801182 run osmo-hlr_10.42.42.2(pid=6781): Launched 12:13:47.028106 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:47.592271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6783): Launched 12:13:47.909264 run osmo-stp_10.42.42.5(pid=6784): Launched 12:13:48.030537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:48.577613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6786): Launched 12:13:48.699099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:48.966941 run patchelf(pid=6787): Launched 12:13:49.143798 run osmo-stp_10.42.42.5(pid=6784): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6784)] 12:13:49.278390 run osmo-stp_10.42.42.5(pid=6784): stdout: | (launched: 2022-12-10_12:13:47.851638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:49.415024 run osmo-stp_10.42.42.5(pid=6784): stderr: | 20221210121348040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121348040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121348041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121348041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121348042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121348042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121348042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:49.551200 run osmo-stp_10.42.42.5(pid=6784): stdout: | (launched: 2022-12-10_12:13:47.851638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:49.681473 run osmo-stp_10.42.42.5(pid=6784): stderr: | 20221210121348040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121348040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121348041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121348041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121348042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121348042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121348042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:49.836234 run patchelf(pid=6787): Terminating (SIGINT) 12:13:50.013817 run patchelf(pid=6787): Terminated: ok {rc=0} 12:13:50.141612 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6784): Process ended prematurely: osmo-stp_10.42.42.5(pid=6784) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6784)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:13:50.151743 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:13:50.180932 run osmo-hlr_10.42.42.2(pid=6781): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6781)] 12:13:50.231236 run osmo-hlr_10.42.42.2(pid=6781): stdout: | (launched: 2022-12-10_12:13:46.733922) 12:13:50.283160 run osmo-hlr_10.42.42.2(pid=6781): stderr: | 20221210121347059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121347059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121347059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121347059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121347059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121347059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121347083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121347103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121347103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121347103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:50.335341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6770): Terminating (SIGTERM) 12:13:50.378140 run iperf3-srv_10.42.42.10(pid=6771): Terminating (SIGTERM) 12:13:50.420169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6772): Terminating (SIGTERM) 12:13:50.462193 run iperf3-srv_10.42.42.10(pid=6773): Terminating (SIGTERM) 12:13:50.503823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6774): Terminating (SIGTERM) 12:13:50.545659 run iperf3-srv_10.42.42.10(pid=6775): Terminating (SIGTERM) 12:13:50.587348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6776): Terminating (SIGTERM) 12:13:50.629137 run iperf3-srv_10.42.42.10(pid=6777): Terminating (SIGTERM) 12:13:50.671283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6780): Terminating (SIGTERM) 12:13:50.713740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6783): Terminating (SIGTERM) 12:13:50.755544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6786): Terminating (SIGTERM) 12:13:50.797603 --- ParallelTerminationStrategy: PID 6770 died... 12:13:50.817386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6770): Terminated: ok {rc=0} 12:13:50.863711 --- ParallelTerminationStrategy: PID 6771 died... 12:13:50.883138 run iperf3-srv_10.42.42.10(pid=6771): Terminated {rc=256} 12:13:50.928782 --- ParallelTerminationStrategy: PID 6772 died... 12:13:50.948095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6772): Terminated: ok {rc=0} 12:13:50.994440 --- ParallelTerminationStrategy: PID 6773 died... 12:13:51.013694 run iperf3-srv_10.42.42.10(pid=6773): Terminated {rc=256} 12:13:51.059233 --- ParallelTerminationStrategy: PID 6774 died... 12:13:51.078557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6774): Terminated: ok {rc=0} 12:13:51.124689 --- ParallelTerminationStrategy: PID 6775 died... 12:13:51.144112 run iperf3-srv_10.42.42.10(pid=6775): Terminated {rc=256} 12:13:51.190143 --- ParallelTerminationStrategy: PID 6776 died... 12:13:51.209587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6776): Terminated: ok {rc=0} 12:13:51.255748 --- ParallelTerminationStrategy: PID 6777 died... 12:13:51.275122 run iperf3-srv_10.42.42.10(pid=6777): Terminated {rc=256} 12:13:51.321287 --- ParallelTerminationStrategy: PID 6780 died... 12:13:51.340491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6780): Terminated: ok {rc=0} 12:13:51.387147 --- ParallelTerminationStrategy: PID 6783 died... 12:13:51.406695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6783): Terminated: ok {rc=0} 12:13:51.452827 --- ParallelTerminationStrategy: PID 6786 died... 12:13:51.472593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6786): Terminated: ok {rc=0} 12:13:51.559996 bus /gobi_4: Setting Powered False 12:13:52.659195 bus /gobi_4: Setting Powered False 12:13:53.777450 bus /gobi_1: Setting Powered False 12:13:54.875429 bus /gobi_1: Setting Powered False 12:13:55.989861 bus /gobi_0: Setting Powered False 12:13:57.088630 bus /gobi_0: Setting Powered False 12:13:58.204481 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:13:59.306600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.318752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:13:59.386075 tst ping.py: using LAC 28319 12:13:59.508638 tst ping.py: using RAC 14 12:13:59.630753 tst ping.py: using CellId 28319 12:13:59.757997 tst ping.py: using BVCI 28320 12:13:59.865580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.876684 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.887601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.900782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.913077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.924400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.936132 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:13:59.947619 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:14:00.062036 tst ping.py:19: start network... 12:14:00.257282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:00.708360 run create_hlr_db(pid=6788): Launched 12:14:00.826490 bus /gobi_6: Setting Powered False 12:14:01.902702 run create_hlr_db(pid=6788): Terminated: ok {rc=0} 12:14:02.411059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6790): Launched 12:14:02.723057 run osmo-hlr_10.42.42.2(pid=6791): Launched 12:14:02.841650 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:03.380045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6793): Launched 12:14:03.690951 run osmo-stp_10.42.42.5(pid=6794): Launched 12:14:03.810686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:04.346680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6796): Launched 12:14:04.466700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:04.728689 run patchelf(pid=6797): Launched 12:14:04.901737 run osmo-stp_10.42.42.5(pid=6794): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6794)] 12:14:05.033528 run osmo-stp_10.42.42.5(pid=6794): stdout: | (launched: 2022-12-10_12:14:03.634488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:05.166559 run osmo-stp_10.42.42.5(pid=6794): stderr: | 20221210121403824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121403824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121403824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121403825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121403825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121403825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121403825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:05.299463 run osmo-stp_10.42.42.5(pid=6794): stdout: | (launched: 2022-12-10_12:14:03.634488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:05.427388 run osmo-stp_10.42.42.5(pid=6794): stderr: | 20221210121403824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121403824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121403824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121403825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121403825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121403825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121403825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:05.578427 run patchelf(pid=6797): Terminating (SIGINT) 12:14:05.752022 run patchelf(pid=6797): Terminated: ok {rc=0} 12:14:05.877384 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6794): Process ended prematurely: osmo-stp_10.42.42.5(pid=6794) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6794)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 12:14:05.886751 tst ping.py:22: Test FAILED (6.6 sec) 12:14:05.915078 run osmo-hlr_10.42.42.2(pid=6791): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6791)] 12:14:05.965118 run osmo-hlr_10.42.42.2(pid=6791): stdout: | (launched: 2022-12-10_12:14:02.666543) 12:14:06.016641 run osmo-hlr_10.42.42.2(pid=6791): stderr: | 20221210121402862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121402862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121402862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121402862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121402862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121402862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121402875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121402883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121402883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121402883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:06.068475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6790): Terminating (SIGTERM) 12:14:06.110205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6793): Terminating (SIGTERM) 12:14:06.151952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6796): Terminating (SIGTERM) 12:14:06.193863 --- ParallelTerminationStrategy: PID 6790 died... 12:14:06.213753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6790): Terminated: ok {rc=0} 12:14:06.260314 --- ParallelTerminationStrategy: PID 6793 died... 12:14:06.279649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6793): Terminated: ok {rc=0} 12:14:06.325454 --- ParallelTerminationStrategy: PID 6796 died... 12:14:06.344537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6796): Terminated: ok {rc=0} 12:14:06.431275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:14:07.518647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:07.530758 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:14:07.599031 tst ping_idle_ping.py: using LAC 28320 12:14:07.722461 tst ping_idle_ping.py: using RAC 15 12:14:07.843723 tst ping_idle_ping.py: using CellId 28320 12:14:07.965373 tst ping_idle_ping.py: using BVCI 28321 12:14:08.079907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:08.091495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:08.102952 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:08.114349 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:08.125833 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:08.137479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:08.149150 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:08.160396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:14:08.276691 tst ping_idle_ping.py:24: start network... 12:14:08.488234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:08.974398 run create_hlr_db(pid=6798): Launched 12:14:09.094197 bus /gobi_6: Setting Powered False 12:14:10.156685 run create_hlr_db(pid=6798): Terminated: ok {rc=0} 12:14:10.577225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6800): Launched 12:14:10.870174 run osmo-hlr_10.42.42.2(pid=6801): Launched 12:14:10.981809 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:11.495583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6803): Launched 12:14:11.786942 run osmo-stp_10.42.42.5(pid=6804): Launched 12:14:11.898409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:12.403041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6806): Launched 12:14:12.514847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:12.761334 run patchelf(pid=6807): Launched 12:14:12.923569 run osmo-stp_10.42.42.5(pid=6804): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6804)] 12:14:13.046971 run osmo-stp_10.42.42.5(pid=6804): stdout: | (launched: 2022-12-10_12:14:11.733361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:13.172150 run osmo-stp_10.42.42.5(pid=6804): stderr: | 20221210121411903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121411903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121411903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121411903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121411904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121411904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121411904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:13.297512 run osmo-stp_10.42.42.5(pid=6804): stdout: | (launched: 2022-12-10_12:14:11.733361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:13.417155 run osmo-stp_10.42.42.5(pid=6804): stderr: | 20221210121411903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121411903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121411903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121411903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121411904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121411904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121411904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:13.558938 run patchelf(pid=6807): Terminating (SIGINT) 12:14:13.722885 run patchelf(pid=6807): Terminated: ok {rc=0} 12:14:13.841246 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6804): Process ended prematurely: osmo-stp_10.42.42.5(pid=6804) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6804)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:14:13.850011 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 12:14:13.876417 run osmo-hlr_10.42.42.2(pid=6801): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6801)] 12:14:13.923364 run osmo-hlr_10.42.42.2(pid=6801): stdout: | (launched: 2022-12-10_12:14:10.816526) 12:14:13.972507 run osmo-hlr_10.42.42.2(pid=6801): stderr: | 20221210121410991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121410991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121410991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121410991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121410991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121410991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121411003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121411012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121411012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121411012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:14.021905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6800): Terminating (SIGTERM) 12:14:14.061193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6803): Terminating (SIGTERM) 12:14:14.100403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6806): Terminating (SIGTERM) 12:14:14.139920 --- ParallelTerminationStrategy: PID 6800 died... 12:14:14.158911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6800): Terminated: ok {rc=0} 12:14:14.202332 --- ParallelTerminationStrategy: PID 6803 died... 12:14:14.220580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6803): Terminated: ok {rc=0} 12:14:14.263765 --- ParallelTerminationStrategy: PID 6806 died... 12:14:14.282236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6806): Terminated: ok {rc=0} 12:14:14.364375 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:14:15.664258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:14:15.670057 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:14:15.698479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:14:15.735832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:14:15.819610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:14:15.852853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:14:15.899383 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:14:16.504339 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:14:16.570149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:16.584316 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:14:16.659194 tst cs_paging_gprs_active.py: using LAC 28321 12:14:16.779054 tst cs_paging_gprs_active.py: using RAC 16 12:14:16.895798 tst cs_paging_gprs_active.py: using CellId 28321 12:14:17.011229 tst cs_paging_gprs_active.py: using BVCI 28322 12:14:17.120447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.131885 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.143079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.154896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.166550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.177728 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.189506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.200527 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:17.211840 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:17.333539 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:17.450391 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:14:17.651704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:17.949633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6811): Launched 12:14:18.208227 run iperf3-srv_10.42.42.10(pid=6812): Launched 12:14:18.319481 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:14:18.519019 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:18.816482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6813): Launched 12:14:19.074420 run iperf3-srv_10.42.42.10(pid=6814): Launched 12:14:19.185156 tst cs_paging_gprs_active.py:38: start network... 12:14:19.383807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:19.841946 run create_hlr_db(pid=6815): Launched 12:14:19.963821 bus /gobi_6: Setting Powered False 12:14:21.023963 run create_hlr_db(pid=6815): Terminated: ok {rc=0} 12:14:21.437660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6817): Launched 12:14:21.734462 run osmo-hlr_10.42.42.2(pid=6818): Launched 12:14:21.847212 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:22.355665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6820): Launched 12:14:22.652463 run osmo-stp_10.42.42.5(pid=6821): Launched 12:14:22.765636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:23.276032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6823): Launched 12:14:23.389707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:23.645396 run patchelf(pid=6824): Launched 12:14:23.810768 run osmo-stp_10.42.42.5(pid=6821): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6821)] 12:14:23.936358 run osmo-stp_10.42.42.5(pid=6821): stdout: | (launched: 2022-12-10_12:14:22.598127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:24.063782 run osmo-stp_10.42.42.5(pid=6821): stderr: | 20221210121422773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121422773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121422773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121422774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121422774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121422774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121422774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:24.191043 run osmo-stp_10.42.42.5(pid=6821): stdout: | (launched: 2022-12-10_12:14:22.598127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:24.312339 run osmo-stp_10.42.42.5(pid=6821): stderr: | 20221210121422773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121422773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121422773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121422774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121422774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121422774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121422774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:24.456145 run patchelf(pid=6824): Terminating (SIGINT) 12:14:24.623599 run patchelf(pid=6824): Terminated: ok {rc=0} 12:14:24.743910 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6821): Process ended prematurely: osmo-stp_10.42.42.5(pid=6821) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6821)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:14:24.753319 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 12:14:24.780234 run osmo-hlr_10.42.42.2(pid=6818): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6818)] 12:14:24.826981 run osmo-hlr_10.42.42.2(pid=6818): stdout: | (launched: 2022-12-10_12:14:21.679947) 12:14:24.875335 run osmo-hlr_10.42.42.2(pid=6818): stderr: | 20221210121421855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121421855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121421855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121421855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121421855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121421855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121421867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121421878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121421878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121421878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:24.924684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6811): Terminating (SIGTERM) 12:14:24.963678 run iperf3-srv_10.42.42.10(pid=6812): Terminating (SIGTERM) 12:14:25.002512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6813): Terminating (SIGTERM) 12:14:25.041401 run iperf3-srv_10.42.42.10(pid=6814): Terminating (SIGTERM) 12:14:25.080165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6817): Terminating (SIGTERM) 12:14:25.119017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6820): Terminating (SIGTERM) 12:14:25.157820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6823): Terminating (SIGTERM) 12:14:25.196870 --- ParallelTerminationStrategy: PID 6811 died... 12:14:25.215272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6811): Terminated: ok {rc=0} 12:14:25.258397 --- ParallelTerminationStrategy: PID 6812 died... 12:14:25.276476 run iperf3-srv_10.42.42.10(pid=6812): Terminated {rc=256} 12:14:25.319683 --- ParallelTerminationStrategy: PID 6813 died... 12:14:25.337991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6813): Terminated: ok {rc=0} 12:14:25.380928 --- ParallelTerminationStrategy: PID 6814 died... 12:14:25.399205 run iperf3-srv_10.42.42.10(pid=6814): Terminated {rc=256} 12:14:25.442247 --- ParallelTerminationStrategy: PID 6817 died... 12:14:25.460555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6817): Terminated: ok {rc=0} 12:14:25.503488 --- ParallelTerminationStrategy: PID 6820 died... 12:14:25.521750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6820): Terminated: ok {rc=0} 12:14:25.564808 --- ParallelTerminationStrategy: PID 6823 died... 12:14:25.583617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6823): Terminated: ok {rc=0} 12:14:25.668422 bus /gobi_0: Setting Powered False 12:14:26.767965 bus /gobi_0: Setting Powered False 12:14:27.883661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:14:29.030057 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.042307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:14:29.110493 tst iperf3.py: using LAC 28322 12:14:29.236450 tst iperf3.py: using RAC 17 12:14:29.360570 tst iperf3.py: using CellId 28322 12:14:29.485193 tst iperf3.py: using BVCI 28323 12:14:29.600829 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.612458 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.623793 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.635443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.647119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.658671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.670491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.681974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:29.693499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:29.811366 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:14:30.025371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:30.342483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6826): Launched 12:14:30.619024 run iperf3-srv_10.42.42.10(pid=6827): Launched 12:14:30.737952 tst iperf3.py:8: start network... 12:14:30.966172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:31.445943 run create_hlr_db(pid=6828): Launched 12:14:31.599324 bus /gobi_6: Setting Powered False 12:14:32.658291 run create_hlr_db(pid=6828): Terminated: ok {rc=0} 12:14:33.105321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6830): Launched 12:14:33.422915 run osmo-hlr_10.42.42.2(pid=6831): Launched 12:14:33.544361 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:34.092256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6833): Launched 12:14:34.410489 run osmo-stp_10.42.42.5(pid=6834): Launched 12:14:34.532228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:35.078206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6836): Launched 12:14:35.199999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:35.468823 run patchelf(pid=6837): Launched 12:14:35.645531 run osmo-stp_10.42.42.5(pid=6834): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6834)] 12:14:35.780095 run osmo-stp_10.42.42.5(pid=6834): stdout: | (launched: 2022-12-10_12:14:34.352469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:35.916559 run osmo-stp_10.42.42.5(pid=6834): stderr: | 20221210121434544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121434544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121434544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121434545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121434545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121434545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121434545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:36.053353 run osmo-stp_10.42.42.5(pid=6834): stdout: | (launched: 2022-12-10_12:14:34.352469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:36.183878 run osmo-stp_10.42.42.5(pid=6834): stderr: | 20221210121434544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121434544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121434544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121434545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121434545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121434545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121434545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:36.338635 run patchelf(pid=6837): Terminating (SIGINT) 12:14:36.517230 run patchelf(pid=6837): Terminated: ok {rc=0} 12:14:36.646183 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6834): Process ended prematurely: osmo-stp_10.42.42.5(pid=6834) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6834)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 12:14:36.656072 tst iperf3.py:8: Test FAILED (7.7 sec) 12:14:36.685217 run osmo-hlr_10.42.42.2(pid=6831): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6831)] 12:14:36.735283 run osmo-hlr_10.42.42.2(pid=6831): stdout: | (launched: 2022-12-10_12:14:33.365060) 12:14:36.786908 run osmo-hlr_10.42.42.2(pid=6831): stderr: | 20221210121433564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121433564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121433564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121433564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121433564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121433564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121433578 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121433586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121433586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121433586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:36.838677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6826): Terminating (SIGTERM) 12:14:36.880668 run iperf3-srv_10.42.42.10(pid=6827): Terminating (SIGTERM) 12:14:36.922426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6830): Terminating (SIGTERM) 12:14:36.964272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6833): Terminating (SIGTERM) 12:14:37.006306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6836): Terminating (SIGTERM) 12:14:37.048457 --- ParallelTerminationStrategy: PID 6826 died... 12:14:37.068218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6826): Terminated: ok {rc=0} 12:14:37.114924 --- ParallelTerminationStrategy: PID 6827 died... 12:14:37.134340 run iperf3-srv_10.42.42.10(pid=6827): Terminated {rc=256} 12:14:37.180702 --- ParallelTerminationStrategy: PID 6830 died... 12:14:37.200079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6830): Terminated: ok {rc=0} 12:14:37.246454 --- ParallelTerminationStrategy: PID 6833 died... 12:14:37.265986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6833): Terminated: ok {rc=0} 12:14:37.312570 --- ParallelTerminationStrategy: PID 6836 died... 12:14:37.332241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6836): Terminated: ok {rc=0} 12:14:37.420688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:14:38.569316 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:38.584674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:14:38.651164 tst iperf3m4.py: using LAC 28323 12:14:38.775734 tst iperf3m4.py: using RAC 18 12:14:38.900093 tst iperf3m4.py: using CellId 28323 12:14:39.026662 tst iperf3m4.py: using BVCI 28324 12:14:39.142011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.153493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.164786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.176398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.188011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.199716 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.211708 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.223448 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:39.235446 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:39.354307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:39.472175 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:39.589024 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:39.704890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:14:39.904128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:40.200847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6838): Launched 12:14:40.458305 run iperf3-srv_10.42.42.10(pid=6839): Launched 12:14:40.569208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:14:40.767640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:41.063479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6840): Launched 12:14:41.320868 run iperf3-srv_10.42.42.10(pid=6841): Launched 12:14:41.431893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:14:41.629001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:41.925259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6842): Launched 12:14:42.182856 run iperf3-srv_10.42.42.10(pid=6843): Launched 12:14:42.294144 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:14:42.492323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:42.790082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6844): Launched 12:14:43.047357 run iperf3-srv_10.42.42.10(pid=6845): Launched 12:14:43.158346 tst iperf3m4.py:8: start network... 12:14:43.356572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:43.814343 run create_hlr_db(pid=6846): Launched 12:14:43.937879 bus /gobi_6: Setting Powered False 12:14:44.997435 run create_hlr_db(pid=6846): Terminated: ok {rc=0} 12:14:45.431743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6848): Launched 12:14:45.749964 run osmo-hlr_10.42.42.2(pid=6849): Launched 12:14:45.896343 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:46.658556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6851): Launched 12:14:46.999890 run osmo-stp_10.42.42.5(pid=6852): Launched 12:14:47.274695 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:47.826357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6854): Launched 12:14:47.949046 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:48.217720 run patchelf(pid=6855): Launched 12:14:48.394927 run osmo-stp_10.42.42.5(pid=6852): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6852)] 12:14:48.529604 run osmo-stp_10.42.42.5(pid=6852): stdout: | (launched: 2022-12-10_12:14:46.933121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:48.666136 run osmo-stp_10.42.42.5(pid=6852): stderr: | 20221210121447127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121447127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121447128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121447128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121447130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121447131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121447131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:48.803010 run osmo-stp_10.42.42.5(pid=6852): stdout: | (launched: 2022-12-10_12:14:46.933121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:48.933242 run osmo-stp_10.42.42.5(pid=6852): stderr: | 20221210121447127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121447127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121447128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121447128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121447130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121447131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121447131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:49.087715 run patchelf(pid=6855): Terminating (SIGINT) 12:14:49.265699 run patchelf(pid=6855): Terminated: ok {rc=0} 12:14:49.394309 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6852): Process ended prematurely: osmo-stp_10.42.42.5(pid=6852) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6852)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:14:49.404433 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:14:49.433921 run osmo-hlr_10.42.42.2(pid=6849): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6849)] 12:14:49.484048 run osmo-hlr_10.42.42.2(pid=6849): stdout: | (launched: 2022-12-10_12:14:45.692402) 12:14:49.535662 run osmo-hlr_10.42.42.2(pid=6849): stderr: | 20221210121445982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121445982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121445982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121445983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121445983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121445983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121445999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121446019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121446019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121446020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:49.587749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6838): Terminating (SIGTERM) 12:14:49.629692 run iperf3-srv_10.42.42.10(pid=6839): Terminating (SIGTERM) 12:14:49.671570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6840): Terminating (SIGTERM) 12:14:49.713521 run iperf3-srv_10.42.42.10(pid=6841): Terminating (SIGTERM) 12:14:49.755178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6842): Terminating (SIGTERM) 12:14:49.797136 run iperf3-srv_10.42.42.10(pid=6843): Terminating (SIGTERM) 12:14:49.838913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6844): Terminating (SIGTERM) 12:14:49.880838 run iperf3-srv_10.42.42.10(pid=6845): Terminating (SIGTERM) 12:14:49.922635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6848): Terminating (SIGTERM) 12:14:49.964405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6851): Terminating (SIGTERM) 12:14:50.006203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6854): Terminating (SIGTERM) 12:14:50.048084 --- ParallelTerminationStrategy: PID 6838 died... 12:14:50.067988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6838): Terminated: ok {rc=0} 12:14:50.114870 --- ParallelTerminationStrategy: PID 6839 died... 12:14:50.134279 run iperf3-srv_10.42.42.10(pid=6839): Terminated {rc=256} 12:14:50.180676 --- ParallelTerminationStrategy: PID 6840 died... 12:14:50.200128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6840): Terminated: ok {rc=0} 12:14:50.246618 --- ParallelTerminationStrategy: PID 6841 died... 12:14:50.266102 run iperf3-srv_10.42.42.10(pid=6841): Terminated {rc=256} 12:14:50.312315 --- ParallelTerminationStrategy: PID 6842 died... 12:14:50.331802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6842): Terminated: ok {rc=0} 12:14:50.378137 --- ParallelTerminationStrategy: PID 6843 died... 12:14:50.397886 run iperf3-srv_10.42.42.10(pid=6843): Terminated {rc=256} 12:14:50.444281 --- ParallelTerminationStrategy: PID 6844 died... 12:14:50.463832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6844): Terminated: ok {rc=0} 12:14:50.510588 --- ParallelTerminationStrategy: PID 6845 died... 12:14:50.530015 run iperf3-srv_10.42.42.10(pid=6845): Terminated {rc=256} 12:14:50.576396 --- ParallelTerminationStrategy: PID 6848 died... 12:14:50.595996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6848): Terminated: ok {rc=0} 12:14:50.642621 --- ParallelTerminationStrategy: PID 6851 died... 12:14:50.662247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6851): Terminated: ok {rc=0} 12:14:50.708884 --- ParallelTerminationStrategy: PID 6854 died... 12:14:50.728657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6854): Terminated: ok {rc=0} 12:14:50.816432 bus /gobi_4: Setting Powered False 12:14:51.915209 bus /gobi_4: Setting Powered False 12:14:53.031050 bus /gobi_1: Setting Powered False 12:14:54.128883 bus /gobi_1: Setting Powered False 12:14:55.246962 bus /gobi_0: Setting Powered False 12:14:56.345354 bus /gobi_0: Setting Powered False 12:14:57.460548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:14:58.562755 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:58.574245 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:14:58.638313 tst ping.py: using LAC 28324 12:14:58.762230 tst ping.py: using RAC 19 12:14:58.886953 tst ping.py: using CellId 28324 12:14:59.009209 tst ping.py: using BVCI 28325 12:14:59.122030 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:59.133502 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:59.144665 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:59.156433 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:59.167896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:59.179356 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:59.190924 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:14:59.202427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:14:59.314422 tst ping.py:19: start network... 12:14:59.508038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:59.958540 run create_hlr_db(pid=6856): Launched 12:15:00.077444 bus /gobi_6: Setting Powered False 12:15:01.140713 run create_hlr_db(pid=6856): Terminated: ok {rc=0} 12:15:01.585743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Launched 12:15:01.913754 run osmo-hlr_10.42.42.2(pid=6862): Launched 12:15:02.088617 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:02.733058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Launched 12:15:03.045805 run osmo-stp_10.42.42.5(pid=6865): Launched 12:15:03.165241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:03.703321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6867): Launched 12:15:03.823131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:04.087019 run patchelf(pid=6868): Launched 12:15:04.260625 run osmo-stp_10.42.42.5(pid=6865): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6865)] 12:15:04.392497 run osmo-stp_10.42.42.5(pid=6865): stdout: | (launched: 2022-12-10_12:15:02.989304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:04.526689 run osmo-stp_10.42.42.5(pid=6865): stderr: | 20221210121503180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121503180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121503180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121503181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121503181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121503181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121503181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:04.660163 run osmo-stp_10.42.42.5(pid=6865): stdout: | (launched: 2022-12-10_12:15:02.989304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:04.788138 run osmo-stp_10.42.42.5(pid=6865): stderr: | 20221210121503180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121503180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121503180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121503181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121503181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121503181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121503181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:04.939640 run patchelf(pid=6868): Terminating (SIGINT) 12:15:05.114065 run patchelf(pid=6868): Terminated: ok {rc=0} 12:15:05.239914 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6865): Process ended prematurely: osmo-stp_10.42.42.5(pid=6865) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6865)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 12:15:05.249476 tst ping.py:22: Test FAILED (6.7 sec) 12:15:05.277787 run osmo-hlr_10.42.42.2(pid=6862): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6862)] 12:15:05.327875 run osmo-hlr_10.42.42.2(pid=6862): stdout: | (launched: 2022-12-10_12:15:01.832133) 12:15:05.379166 run osmo-hlr_10.42.42.2(pid=6862): stderr: | 20221210121502238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121502238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121502239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121502239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121502239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121502239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121502269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121502294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121502294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121502294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:05.431574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Terminating (SIGTERM) 12:15:05.473078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Terminating (SIGTERM) 12:15:05.514558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6867): Terminating (SIGTERM) 12:15:05.556369 --- ParallelTerminationStrategy: PID 6861 died... 12:15:05.576280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Terminated: ok {rc=0} 12:15:05.623018 --- ParallelTerminationStrategy: PID 6864 died... 12:15:05.642437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Terminated: ok {rc=0} 12:15:05.689195 --- ParallelTerminationStrategy: PID 6867 died... 12:15:05.708430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6867): Terminated: ok {rc=0} 12:15:05.795964 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:15:06.882929 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:06.894600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:15:06.966484 tst ping_idle_ping.py: using LAC 28325 12:15:07.080541 tst ping_idle_ping.py: using RAC 20 12:15:07.194276 tst ping_idle_ping.py: using CellId 28325 12:15:07.307291 tst ping_idle_ping.py: using BVCI 28326 12:15:07.412729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:07.423786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:07.434474 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:07.445721 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:07.456928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:07.468090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:07.479412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:07.490602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:15:07.603771 tst ping_idle_ping.py:24: start network... 12:15:07.799562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:08.254354 run create_hlr_db(pid=6869): Launched 12:15:08.374468 bus /gobi_6: Setting Powered False 12:15:09.433654 run create_hlr_db(pid=6869): Terminated: ok {rc=0} 12:15:09.862294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6871): Launched 12:15:10.176451 run osmo-hlr_10.42.42.2(pid=6872): Launched 12:15:10.297478 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:10.840838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6874): Launched 12:15:11.154041 run osmo-stp_10.42.42.5(pid=6875): Launched 12:15:11.274212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:11.815462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6877): Launched 12:15:11.935582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:12.200632 run patchelf(pid=6878): Launched 12:15:12.374809 run osmo-stp_10.42.42.5(pid=6875): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6875)] 12:15:12.508630 run osmo-stp_10.42.42.5(pid=6875): stdout: | (launched: 2022-12-10_12:15:11.096878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:12.643155 run osmo-stp_10.42.42.5(pid=6875): stderr: | 20221210121511286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121511286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121511286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121511287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121511287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121511287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121511287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:12.777599 run osmo-stp_10.42.42.5(pid=6875): stdout: | (launched: 2022-12-10_12:15:11.096878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:12.906688 run osmo-stp_10.42.42.5(pid=6875): stderr: | 20221210121511286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121511286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121511286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121511287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121511287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121511287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121511287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:13.059296 run patchelf(pid=6878): Terminating (SIGINT) 12:15:13.234724 run patchelf(pid=6878): Terminated: ok {rc=0} 12:15:13.360730 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6875): Process ended prematurely: osmo-stp_10.42.42.5(pid=6875) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6875)] [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:15:13.370402 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:15:13.399225 run osmo-hlr_10.42.42.2(pid=6872): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6872)] 12:15:13.449369 run osmo-hlr_10.42.42.2(pid=6872): stdout: | (launched: 2022-12-10_12:15:10.118604) 12:15:13.501100 run osmo-hlr_10.42.42.2(pid=6872): stderr: | 20221210121510314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121510314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121510314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121510314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121510314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121510314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121510327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121510337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121510337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121510337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:13.553101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6871): Terminating (SIGTERM) 12:15:13.594804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6874): Terminating (SIGTERM) 12:15:13.636581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6877): Terminating (SIGTERM) 12:15:13.678624 --- ParallelTerminationStrategy: PID 6871 died... 12:15:13.698521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6871): Terminated: ok {rc=0} 12:15:13.745184 --- ParallelTerminationStrategy: PID 6874 died... 12:15:13.764734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6874): Terminated: ok {rc=0} 12:15:13.811274 --- ParallelTerminationStrategy: PID 6877 died... 12:15:13.830646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6877): Terminated: ok {rc=0} 12:15:13.918299 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:15:15.222805 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:15.230262 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:15:15.261351 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:15:15.296272 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:15:15.349649 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:15:15.379370 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:15:15.414865 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:15:16.001163 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:15:16.007189 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.019312 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:15:16.087912 tst switch_tch_pdch.py: using LAC 28326 12:15:16.227390 tst switch_tch_pdch.py: using RAC 21 12:15:16.371361 tst switch_tch_pdch.py: using CellId 28326 12:15:16.521320 tst switch_tch_pdch.py: using BVCI 28327 12:15:16.672714 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.687318 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.700003 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.711988 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.723967 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.735896 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.747872 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:15:16.762597 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:15:16.881037 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:15:16.998775 tst switch_tch_pdch.py:51: start network... 12:15:17.198446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:17.652153 run create_hlr_db(pid=6883): Launched 12:15:17.775900 bus /gobi_6: Setting Powered False 12:15:18.837509 run create_hlr_db(pid=6883): Terminated: ok {rc=0} 12:15:19.272836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6885): Launched 12:15:19.586754 run osmo-hlr_10.42.42.2(pid=6886): Launched 12:15:19.706263 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:20.241658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6888): Launched 12:15:20.553937 run osmo-stp_10.42.42.5(pid=6889): Launched 12:15:20.673270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:21.211997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6891): Launched 12:15:21.327529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:21.573567 run patchelf(pid=6892): Launched 12:15:21.735864 run osmo-stp_10.42.42.5(pid=6889): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6889)] 12:15:21.858873 run osmo-stp_10.42.42.5(pid=6889): stdout: | (launched: 2022-12-10_12:15:20.497311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:21.983636 run osmo-stp_10.42.42.5(pid=6889): stderr: | 20221210121520689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121520689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121520689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121520689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121520690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121520690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121520690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:22.108458 run osmo-stp_10.42.42.5(pid=6889): stdout: | (launched: 2022-12-10_12:15:20.497311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:22.227597 run osmo-stp_10.42.42.5(pid=6889): stderr: | 20221210121520689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121520689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121520689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121520689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121520690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121520690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121520690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:22.368601 run patchelf(pid=6892): Terminating (SIGINT) 12:15:22.531858 run patchelf(pid=6892): Terminated: ok {rc=0} 12:15:22.649252 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6889): Process ended prematurely: osmo-stp_10.42.42.5(pid=6889) [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6889)] [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:15:22.658012 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 12:15:22.684375 run osmo-hlr_10.42.42.2(pid=6886): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6886)] 12:15:22.731155 run osmo-hlr_10.42.42.2(pid=6886): stdout: | (launched: 2022-12-10_12:15:19.529221) 12:15:22.779786 run osmo-hlr_10.42.42.2(pid=6886): stderr: | 20221210121519725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121519726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121519726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121519726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121519726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121519726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121519737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121519745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121519745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121519745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:22.828594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6885): Terminating (SIGTERM) 12:15:22.867733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6888): Terminating (SIGTERM) 12:15:22.906749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6891): Terminating (SIGTERM) 12:15:22.946104 --- ParallelTerminationStrategy: PID 6885 died... 12:15:22.965512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6885): Terminated: ok {rc=0} 12:15:23.009269 --- ParallelTerminationStrategy: PID 6888 died... 12:15:23.027720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6888): Terminated: ok {rc=0} 12:15:23.070908 --- ParallelTerminationStrategy: PID 6891 died... 12:15:23.089292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6891): Terminated: ok {rc=0} 12:15:23.171535 bus /gobi_0: Setting Powered False 12:15:24.266597 bus /gobi_0: Setting Powered False 12:15:25.378564 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:15:26.631492 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:26.637654 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:15:26.668009 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:15:26.703118 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:15:26.756750 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:15:26.786234 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:15:26.821035 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:15:27.377942 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:15:27.383101 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:27.394485 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:15:27.460891 tst switch_tch_pdch.py: using LAC 28327 12:15:27.582977 tst switch_tch_pdch.py: using RAC 22 12:15:27.704545 tst switch_tch_pdch.py: using CellId 28327 12:15:27.825998 tst switch_tch_pdch.py: using BVCI 28328 12:15:27.940799 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:27.952311 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:27.963518 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:27.975094 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:27.986652 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:27.998152 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:28.009720 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:15:28.021138 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:15:28.135907 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:15:28.251727 tst switch_tch_pdch.py:51: start network... 12:15:28.464233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:28.921308 run create_hlr_db(pid=6896): Launched 12:15:29.040697 bus /gobi_6: Setting Powered False 12:15:30.103309 run create_hlr_db(pid=6896): Terminated: ok {rc=0} 12:15:30.497601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6898): Launched 12:15:30.789791 run osmo-hlr_10.42.42.2(pid=6899): Launched 12:15:30.959461 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:31.591091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6901): Launched 12:15:31.910458 run osmo-stp_10.42.42.5(pid=6902): Launched 12:15:32.169185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:32.747116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6904): Launched 12:15:32.858251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:33.103748 run patchelf(pid=6905): Launched 12:15:33.265353 run osmo-stp_10.42.42.5(pid=6902): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6902)] 12:15:33.388239 run osmo-stp_10.42.42.5(pid=6902): stdout: | (launched: 2022-12-10_12:15:31.849404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:33.512779 run osmo-stp_10.42.42.5(pid=6902): stderr: | 20221210121532117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121532117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121532117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121532118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121532118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121532118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121532118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:33.637637 run osmo-stp_10.42.42.5(pid=6902): stdout: | (launched: 2022-12-10_12:15:31.849404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:33.756570 run osmo-stp_10.42.42.5(pid=6902): stderr: | 20221210121532117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121532117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121532117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121532118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121532118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121532118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121532118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:33.897852 run patchelf(pid=6905): Terminating (SIGINT) 12:15:34.060935 run patchelf(pid=6905): Terminated: ok {rc=0} 12:15:34.178439 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6902): Process ended prematurely: osmo-stp_10.42.42.5(pid=6902) [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6902)] [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:15:34.187175 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 12:15:34.213520 run osmo-hlr_10.42.42.2(pid=6899): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6899)] 12:15:34.260358 run osmo-hlr_10.42.42.2(pid=6899): stdout: | (launched: 2022-12-10_12:15:30.736527) 12:15:34.308919 run osmo-hlr_10.42.42.2(pid=6899): stderr: | 20221210121530993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121530993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121530993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121530994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121530994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121530994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121531018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121531029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121531030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121531030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:34.357970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6898): Terminating (SIGTERM) 12:15:34.397153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6901): Terminating (SIGTERM) 12:15:34.436670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6904): Terminating (SIGTERM) 12:15:34.476821 --- ParallelTerminationStrategy: PID 6898 died... 12:15:34.495750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6898): Terminated: ok {rc=0} 12:15:34.539897 --- ParallelTerminationStrategy: PID 6901 died... 12:15:34.558415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6901): Terminated: ok {rc=0} 12:15:34.601791 --- ParallelTerminationStrategy: PID 6904 died... 12:15:34.620101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6904): Terminated: ok {rc=0} 12:15:34.704584 bus /gobi_0: Setting Powered False 12:15:35.803310 bus /gobi_0: Setting Powered False 12:15:36.916827 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_sms:nanobts --------------------------------------------------------------------- 12:15:38.160393 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:38.163908 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 12:15:38.186857 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 12:15:38.194605 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 12:15:38.245482 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 12:15:38.268541 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 12:15:38.275221 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 12:15:38.811226 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 12:15:38.816123 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 12:15:38.826838 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 12:15:38.863535 tst mo_mt_sms.py: using LAC 28328 12:15:38.976739 tst mo_mt_sms.py: using RAC 23 12:15:39.088632 tst mo_mt_sms.py: using CellId 28328 12:15:39.203228 tst mo_mt_sms.py: using BVCI 28329 12:15:39.307660 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:15:39.423153 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:15:39.537298 tst mo_mt_sms.py:9: start nitb and bts... 12:15:39.733047 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:15:40.329152 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6910): Launched 12:15:40.620343 run osmo-nitb_10.42.42.2(pid=6911): Launched 12:15:40.782708 run osmo-nitb_10.42.42.2(pid=6911): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6911)] 12:15:40.913796 run osmo-nitb_10.42.42.2(pid=6911): stdout: | (launched: 2022-12-10_12:15:40.566962) 12:15:41.046324 run osmo-nitb_10.42.42.2(pid=6911): stderr: | (launched: 2022-12-10_12:15:40.610342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:15:41.179428 run osmo-nitb_10.42.42.2(pid=6911): stdout: | (launched: 2022-12-10_12:15:40.566962) 12:15:41.306045 run osmo-nitb_10.42.42.2(pid=6911): stderr: | (launched: 2022-12-10_12:15:40.610342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6911): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6911) [trial-2374↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6911)] 12:15:41.731074 tst osmo-nitb_10.42.42.2(pid=6911): stdout: | (launched: 2022-12-10_12:15:40.566962) 12:15:41.860522 tst osmo-nitb_10.42.42.2(pid=6911): stderr: | (launched: 2022-12-10_12:15:40.610342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:15:42.000133 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6911): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6911) [trial-2374↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6911)] [trial-2374↪nitb_sms:nanobts↪mo_mt_sms.py:11] 12:15:42.008505 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 12:15:42.014956 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6910): Terminating (SIGTERM) 12:15:42.222999 --- ParallelTerminationStrategy: PID 6910 died... 12:15:42.243455 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6910): Terminated: ok {rc=0} 12:15:42.328102 bus /sierra_3: Setting Powered False 12:15:43.431126 bus /sierra_3: Setting Powered False 12:15:44.547978 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:nanobts+band-1900 --------------------------------------------------------------------- 12:15:45.730585 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:45.735649 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:15:45.759741 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:15:45.787273 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 12:15:45.846479 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:15:45.881265 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:15:45.910012 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 12:15:46.444544 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 12:15:46.450322 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:15:46.462014 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:15:46.500490 tst mo_mt_sms.py: using LAC 28329 12:15:46.622487 tst mo_mt_sms.py: using RAC 24 12:15:46.749587 tst mo_mt_sms.py: using CellId 28329 12:15:46.918928 tst mo_mt_sms.py: using BVCI 28330 12:15:47.058602 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:15:47.072196 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:15:47.085500 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:15:47.098893 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:15:47.112084 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:15:47.125850 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:15:47.250108 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:15:47.371206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:47.855225 run create_hlr_db(pid=6916): Launched 12:15:47.974739 bus /sierra_2: Setting Powered False 12:15:49.036557 run create_hlr_db(pid=6916): Terminated: ok {rc=0} 12:15:49.453962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6918): Launched 12:15:49.744815 run osmo-hlr_10.42.42.2(pid=6919): Launched 12:15:49.856234 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:50.355917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6921): Launched 12:15:50.646083 run osmo-stp_10.42.42.5(pid=6922): Launched 12:15:50.756117 run osmo-msc_10.42.42.6: Starting osmo-msc 12:15:51.281342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6924): Launched 12:15:51.572913 run osmo-msc_10.42.42.6(pid=6925): Launched 12:15:51.736271 run osmo-stp_10.42.42.5(pid=6922): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6922)] 12:15:51.859064 run osmo-stp_10.42.42.5(pid=6922): stdout: | (launched: 2022-12-10_12:15:50.592439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:51.983712 run osmo-stp_10.42.42.5(pid=6922): stderr: | 20221210121550762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121550762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121550762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121550763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121550763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121550763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121550763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:52.104243 run osmo-stp_10.42.42.5(pid=6922): stdout: | (launched: 2022-12-10_12:15:50.592439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:52.220645 run osmo-stp_10.42.42.5(pid=6922): stderr: | 20221210121550762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121550762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121550762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121550763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121550763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121550763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121550763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:52.359240 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6922): Process ended prematurely: osmo-stp_10.42.42.5(pid=6922) [trial-2374↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6922)] [trial-2374↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 12:15:52.367244 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 12:15:52.392745 run osmo-hlr_10.42.42.2(pid=6919): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6919)] 12:15:52.439812 run osmo-hlr_10.42.42.2(pid=6919): stdout: | (launched: 2022-12-10_12:15:49.691493) 12:15:52.488124 run osmo-hlr_10.42.42.2(pid=6919): stderr: | 20221210121549869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121549869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121549869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121549869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121549869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121549869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121549881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121549889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121549889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121549889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:52.555689 run osmo-msc_10.42.42.6(pid=6925): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6925)] 12:15:52.602782 run osmo-msc_10.42.42.6(pid=6925): stdout: | (launched: 2022-12-10_12:15:51.519658) 12:15:52.650924 run osmo-msc_10.42.42.6(pid=6925): stderr: | 20221210121551793 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121551793 DLGLOBAL DEBUG validating counter group 0x7f65f81e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121551793 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121551793 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121551793 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121551793 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121551795 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121551795 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121551796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121551796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:15:52.699623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6918): Terminating (SIGTERM) 12:15:52.738446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6921): Terminating (SIGTERM) 12:15:52.777236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6924): Terminating (SIGTERM) 12:15:52.816291 --- ParallelTerminationStrategy: PID 6918 died... 12:15:52.835107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6918): Terminated: ok {rc=0} 12:15:52.878270 --- ParallelTerminationStrategy: PID 6921 died... 12:15:52.896397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6921): Terminated: ok {rc=0} 12:15:52.940127 --- ParallelTerminationStrategy: PID 6924 died... 12:15:52.958357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6924): Terminated: ok {rc=0} 12:15:53.041037 bus /sierra_3: Setting Powered False 12:15:54.137703 bus /sierra_3: Setting Powered False 12:15:55.254758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:15:56.475625 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:56.480784 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:15:56.505375 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 12:15:56.512447 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:15:56.548343 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:15:56.572368 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 12:15:56.579809 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:15:57.099082 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:15:57.104615 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 12:15:57.115966 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:15:57.156455 tst assert_extension.py: using LAC 28330 12:15:57.278921 tst assert_extension.py: using RAC 25 12:15:57.402492 tst assert_extension.py: using CellId 28330 12:15:57.525045 tst assert_extension.py: using BVCI 28331 12:15:57.637583 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:15:57.751286 tst assert_extension.py:10: start nitb and bts... 12:15:57.962091 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:15:58.599310 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6930): Launched 12:15:58.912743 run osmo-nitb_10.42.42.2(pid=6932): Launched 12:15:59.086345 run osmo-nitb_10.42.42.2(pid=6932): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6932)] 12:15:59.226069 run osmo-nitb_10.42.42.2(pid=6932): stdout: | (launched: 2022-12-10_12:15:58.856165) 12:15:59.368120 run osmo-nitb_10.42.42.2(pid=6932): stderr: | (launched: 2022-12-10_12:15:58.902437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:15:59.509936 run osmo-nitb_10.42.42.2(pid=6932): stdout: | (launched: 2022-12-10_12:15:58.856165) 12:15:59.645772 run osmo-nitb_10.42.42.2(pid=6932): stderr: | (launched: 2022-12-10_12:15:58.902437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6932): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6932) [trial-2374↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6932)] 12:16:00.031268 tst osmo-nitb_10.42.42.2(pid=6932): stdout: | (launched: 2022-12-10_12:15:58.856165) 12:16:00.157724 tst osmo-nitb_10.42.42.2(pid=6932): stderr: | (launched: 2022-12-10_12:15:58.902437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:16:00.306727 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6932): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6932) [trial-2374↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6932)] [trial-2374↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 12:16:00.315739 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:16:00.322671 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6930): Terminating (SIGTERM) 12:16:00.533408 --- ParallelTerminationStrategy: PID 6930 died... 12:16:00.554272 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6930): Terminated: ok {rc=0} 12:16:00.641762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:16:01.826356 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:16:01.831021 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:16:01.856096 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:16:01.884852 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:16:01.919669 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:16:01.943511 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:16:01.970535 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:16:02.497724 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:16:02.502858 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:16:02.513597 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:16:02.550560 tst assert_extension.py: using LAC 28331 12:16:02.665390 tst assert_extension.py: using RAC 26 12:16:02.780076 tst assert_extension.py: using CellId 28331 12:16:02.896414 tst assert_extension.py: using BVCI 28332 12:16:03.002078 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:16:03.012504 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:16:03.022890 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:16:03.033521 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:16:03.044008 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:16:03.054708 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:16:03.165350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:03.617692 run create_hlr_db(pid=6936): Launched 12:16:03.736731 bus /sierra_2: Setting Powered False 12:16:04.795487 run create_hlr_db(pid=6936): Terminated: ok {rc=0} 12:16:05.203316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6938): Launched 12:16:05.494718 run osmo-hlr_10.42.42.2(pid=6939): Launched 12:16:05.606171 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:06.125647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6941): Launched 12:16:06.416604 run osmo-stp_10.42.42.5(pid=6942): Launched 12:16:06.528336 run osmo-msc_10.42.42.6: Starting osmo-msc 12:16:07.055658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6944): Launched 12:16:07.346816 run osmo-msc_10.42.42.6(pid=6945): Launched 12:16:07.511274 run osmo-stp_10.42.42.5(pid=6942): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6942)] 12:16:07.635016 run osmo-stp_10.42.42.5(pid=6942): stdout: | (launched: 2022-12-10_12:16:06.363353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:07.757800 run osmo-stp_10.42.42.5(pid=6942): stderr: | 20221210121606532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121606532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121606533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121606533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121606533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121606534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121606534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:07.878888 run osmo-stp_10.42.42.5(pid=6942): stdout: | (launched: 2022-12-10_12:16:06.363353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:07.995081 run osmo-stp_10.42.42.5(pid=6942): stderr: | 20221210121606532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121606532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121606533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121606533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121606533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121606534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121606534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:08.134090 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6942): Process ended prematurely: osmo-stp_10.42.42.5(pid=6942) [trial-2374↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6942)] [trial-2374↪ussd:nanobts+band-1900↪assert_extension.py:17] 12:16:08.142265 tst assert_extension.py:17: Test FAILED (5.6 sec) 12:16:08.167981 run osmo-hlr_10.42.42.2(pid=6939): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6939)] 12:16:08.215119 run osmo-hlr_10.42.42.2(pid=6939): stdout: | (launched: 2022-12-10_12:16:05.441459) 12:16:08.263802 run osmo-hlr_10.42.42.2(pid=6939): stderr: | 20221210121605616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121605617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121605617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121605617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121605617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121605617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121605629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121605637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121605637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121605638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:08.331842 run osmo-msc_10.42.42.6(pid=6945): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6945)] 12:16:08.378928 run osmo-msc_10.42.42.6(pid=6945): stdout: | (launched: 2022-12-10_12:16:07.292565) 12:16:08.427485 run osmo-msc_10.42.42.6(pid=6945): stderr: | 20221210121607564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121607565 DLGLOBAL DEBUG validating counter group 0x7fe51bdafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121607565 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121607565 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121607565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121607565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121607567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121607567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121607567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121607568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:16:08.476477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6938): Terminating (SIGTERM) 12:16:08.515420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6941): Terminating (SIGTERM) 12:16:08.554383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6944): Terminating (SIGTERM) 12:16:08.593579 --- ParallelTerminationStrategy: PID 6938 died... 12:16:08.612298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6938): Terminated: ok {rc=0} 12:16:08.655826 --- ParallelTerminationStrategy: PID 6941 died... 12:16:08.674298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6941): Terminated: ok {rc=0} 12:16:08.717638 --- ParallelTerminationStrategy: PID 6944 died... 12:16:08.736066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6944): Terminated: ok {rc=0} 12:16:08.821474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:16:10.018164 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:16:10.025548 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:16:10.048990 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:16:10.074957 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:16:10.126786 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:16:10.150858 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:16:10.178592 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:16:10.726518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:16:10.776661 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:10.787742 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:16:10.844855 tst mo_mt_call.py: using LAC 28332 12:16:10.960542 tst mo_mt_call.py: using RAC 27 12:16:11.075764 tst mo_mt_call.py: using CellId 28332 12:16:11.189963 tst mo_mt_call.py: using BVCI 28333 12:16:11.296217 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:11.307225 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:11.318037 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:11.328794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:11.340112 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:11.350931 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:16:11.467886 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:16:11.582800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:12.073940 run create_hlr_db(pid=6950): Launched 12:16:12.195921 bus /sierra_2: Setting Powered False 12:16:13.259501 run create_hlr_db(pid=6950): Terminated: ok {rc=0} 12:16:13.704028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6952): Launched 12:16:14.021929 run osmo-hlr_10.42.42.2(pid=6953): Launched 12:16:14.143970 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:14.691470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6955): Launched 12:16:15.008592 run osmo-stp_10.42.42.5(pid=6956): Launched 12:16:15.130001 run osmo-msc_10.42.42.6: Starting osmo-msc 12:16:15.705997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6958): Launched 12:16:16.043187 run osmo-msc_10.42.42.6(pid=6959): Launched 12:16:16.306564 run osmo-stp_10.42.42.5(pid=6956): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6956)] 12:16:16.520582 run osmo-stp_10.42.42.5(pid=6956): stdout: | (launched: 2022-12-10_12:16:14.951197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:16.752900 run osmo-stp_10.42.42.5(pid=6956): stderr: | 20221210121615141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121615141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121615141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121615142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121615142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121615142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121615142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:16.889599 run osmo-stp_10.42.42.5(pid=6956): stdout: | (launched: 2022-12-10_12:16:14.951197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:17.020638 run osmo-stp_10.42.42.5(pid=6956): stderr: | 20221210121615141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121615141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121615141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121615142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121615142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121615142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121615142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:17.177048 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6956): Process ended prematurely: osmo-stp_10.42.42.5(pid=6956) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6956)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:16:17.187575 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:16:17.218900 run osmo-hlr_10.42.42.2(pid=6953): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6953)] 12:16:17.271337 run osmo-hlr_10.42.42.2(pid=6953): stdout: | (launched: 2022-12-10_12:16:13.964064) 12:16:17.325366 run osmo-hlr_10.42.42.2(pid=6953): stderr: | 20221210121614159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121614159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121614159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121614159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121614159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121614159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121614171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121614180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121614180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121614180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:17.400466 run osmo-msc_10.42.42.6(pid=6959): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6959)] 12:16:17.451384 run osmo-msc_10.42.42.6(pid=6959): stdout: | (launched: 2022-12-10_12:16:15.977440) 12:16:17.503854 run osmo-msc_10.42.42.6(pid=6959): stderr: | 20221210121616495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121616495 DLGLOBAL DEBUG validating counter group 0x7fe03f141c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121616495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121616495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121616496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121616496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121616498 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121616498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121616498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121616498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:16:17.556423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6952): Terminating (SIGTERM) 12:16:17.598319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6955): Terminating (SIGTERM) 12:16:17.640202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6958): Terminating (SIGTERM) 12:16:17.682470 --- ParallelTerminationStrategy: PID 6952 died... 12:16:17.702358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6952): Terminated: ok {rc=0} 12:16:17.749220 --- ParallelTerminationStrategy: PID 6955 died... 12:16:17.768775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6955): Terminated: ok {rc=0} 12:16:17.815546 --- ParallelTerminationStrategy: PID 6958 died... 12:16:17.835118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6958): Terminated: ok {rc=0} 12:16:17.923614 bus /sierra_3: Setting Powered False 12:16:19.020083 bus /sierra_3: Setting Powered False 12:16:20.135607 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:16:21.275429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:21.286967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:16:21.345934 tst mo_mt_call_osmux.py: using LAC 28333 12:16:21.463796 tst mo_mt_call_osmux.py: using RAC 28 12:16:21.581436 tst mo_mt_call_osmux.py: using CellId 28333 12:16:21.701894 tst mo_mt_call_osmux.py: using BVCI 28334 12:16:21.810329 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:21.821383 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:21.832171 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:21.843079 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:21.854025 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:16:21.864800 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:16:21.979174 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:16:22.092573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:22.552392 run create_hlr_db(pid=6961): Launched 12:16:22.674844 bus /sierra_2: Setting Powered False 12:16:23.734905 run create_hlr_db(pid=6961): Terminated: ok {rc=0} 12:16:24.168935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Launched 12:16:24.487580 run osmo-hlr_10.42.42.2(pid=6964): Launched 12:16:24.609267 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:25.156568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Launched 12:16:25.475565 run osmo-stp_10.42.42.5(pid=6967): Launched 12:16:25.597514 run osmo-msc_10.42.42.6: Starting osmo-msc 12:16:26.171087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Launched 12:16:26.489278 run osmo-msc_10.42.42.6(pid=6970): Launched 12:16:26.668368 run osmo-stp_10.42.42.5(pid=6967): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] 12:16:26.802803 run osmo-stp_10.42.42.5(pid=6967): stdout: | (launched: 2022-12-10_12:16:25.416833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:26.937582 run osmo-stp_10.42.42.5(pid=6967): stderr: | 20221210121625609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121625610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121625610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121625610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121625612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121625613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121625613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:27.071269 run osmo-stp_10.42.42.5(pid=6967): stdout: | (launched: 2022-12-10_12:16:25.416833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:27.198170 run osmo-stp_10.42.42.5(pid=6967): stderr: | 20221210121625609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121625610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121625610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121625610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121625612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121625613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121625613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:27.349917 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6967): Process ended prematurely: osmo-stp_10.42.42.5(pid=6967) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:16:27.359310 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:16:27.387401 run osmo-hlr_10.42.42.2(pid=6964): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6964)] 12:16:27.437631 run osmo-hlr_10.42.42.2(pid=6964): stdout: | (launched: 2022-12-10_12:16:24.429516) 12:16:27.489596 run osmo-hlr_10.42.42.2(pid=6964): stderr: | 20221210121624629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121624629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121624629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121624629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121624629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121624629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121624642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121624650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121624650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121624650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:27.561282 run osmo-msc_10.42.42.6(pid=6970): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6970)] 12:16:27.611203 run osmo-msc_10.42.42.6(pid=6970): stdout: | (launched: 2022-12-10_12:16:26.430967) 12:16:27.662555 run osmo-msc_10.42.42.6(pid=6970): stderr: | 20221210121626753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121626753 DLGLOBAL DEBUG validating counter group 0x7f9bd2150c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121626753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121626753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121626753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121626753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121626755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121626755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121626756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121626756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:16:27.714506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Terminating (SIGTERM) 12:16:27.755726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Terminating (SIGTERM) 12:16:27.796923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Terminating (SIGTERM) 12:16:27.839082 --- ParallelTerminationStrategy: PID 6963 died... 12:16:27.858661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Terminated: ok {rc=0} 12:16:27.904639 --- ParallelTerminationStrategy: PID 6966 died... 12:16:27.923657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Terminated: ok {rc=0} 12:16:27.969712 --- ParallelTerminationStrategy: PID 6969 died... 12:16:27.989054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Terminated: ok {rc=0} 12:16:28.075376 bus /sierra_3: Setting Powered False 12:16:29.172204 bus /sierra_3: Setting Powered False 12:16:30.284918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:16:31.559891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:16:31.567859 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:16:31.599118 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:16:31.627974 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:16:31.682855 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:16:31.714558 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:16:31.749821 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:16:32.294712 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:16:32.344094 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:32.355226 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:16:32.417056 tst mo_mt_call.py: using LAC 28334 12:16:32.533187 tst mo_mt_call.py: using RAC 29 12:16:32.648605 tst mo_mt_call.py: using CellId 28334 12:16:32.763977 tst mo_mt_call.py: using BVCI 28335 12:16:32.871467 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:32.882475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:32.893306 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:32.904661 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:32.916179 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:32.927513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:16:33.041411 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:16:33.154279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:33.613825 run create_hlr_db(pid=6975): Launched 12:16:33.735297 bus /sierra_2: Setting Powered False 12:16:34.794838 run create_hlr_db(pid=6975): Terminated: ok {rc=0} 12:16:35.229914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6977): Launched 12:16:35.549027 run osmo-hlr_10.42.42.2(pid=6978): Launched 12:16:35.672385 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:36.223603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6980): Launched 12:16:36.543930 run osmo-stp_10.42.42.5(pid=6981): Launched 12:16:36.666860 run osmo-msc_10.42.42.6: Starting osmo-msc 12:16:37.242046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6983): Launched 12:16:37.561201 run osmo-msc_10.42.42.6(pid=6984): Launched 12:16:37.739876 run osmo-stp_10.42.42.5(pid=6981): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6981)] 12:16:37.874496 run osmo-stp_10.42.42.5(pid=6981): stdout: | (launched: 2022-12-10_12:16:36.485680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:38.009691 run osmo-stp_10.42.42.5(pid=6981): stderr: | 20221210121636680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121636680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121636680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121636680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121636681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121636681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121636681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:38.143927 run osmo-stp_10.42.42.5(pid=6981): stdout: | (launched: 2022-12-10_12:16:36.485680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:38.271124 run osmo-stp_10.42.42.5(pid=6981): stderr: | 20221210121636680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121636680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121636680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121636680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121636681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121636681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121636681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:38.423034 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6981): Process ended prematurely: osmo-stp_10.42.42.5(pid=6981) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6981)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:16:38.432361 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:16:38.460627 run osmo-hlr_10.42.42.2(pid=6978): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6978)] 12:16:38.510303 run osmo-hlr_10.42.42.2(pid=6978): stdout: | (launched: 2022-12-10_12:16:35.490698) 12:16:38.561889 run osmo-hlr_10.42.42.2(pid=6978): stderr: | 20221210121635690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121635690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121635690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121635690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121635690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121635690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121635705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121635713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121635713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121635713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:38.633525 run osmo-msc_10.42.42.6(pid=6984): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6984)] 12:16:38.683169 run osmo-msc_10.42.42.6(pid=6984): stdout: | (launched: 2022-12-10_12:16:37.502919) 12:16:38.734299 run osmo-msc_10.42.42.6(pid=6984): stderr: | 20221210121637827 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121637827 DLGLOBAL DEBUG validating counter group 0x7f92e1125c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121637827 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121637827 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121637828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121637828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121637829 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121637830 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121637830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121637830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:16:38.785740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6977): Terminating (SIGTERM) 12:16:38.827222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6980): Terminating (SIGTERM) 12:16:38.868255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6983): Terminating (SIGTERM) 12:16:38.909698 --- ParallelTerminationStrategy: PID 6977 died... 12:16:38.929361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6977): Terminated: ok {rc=0} 12:16:38.975072 --- ParallelTerminationStrategy: PID 6980 died... 12:16:38.994374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6980): Terminated: ok {rc=0} 12:16:39.040164 --- ParallelTerminationStrategy: PID 6983 died... 12:16:39.059510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6983): Terminated: ok {rc=0} 12:16:39.146399 bus /sierra_3: Setting Powered False 12:16:40.241440 bus /sierra_3: Setting Powered False 12:16:41.354370 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:16:42.502344 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:42.514476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:16:42.574986 tst mo_mt_call_osmux.py: using LAC 28335 12:16:42.699497 tst mo_mt_call_osmux.py: using RAC 30 12:16:42.818610 tst mo_mt_call_osmux.py: using CellId 28335 12:16:42.944406 tst mo_mt_call_osmux.py: using BVCI 28336 12:16:43.059379 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:43.070774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:43.082227 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:43.093812 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:43.105444 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:16:43.117759 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:16:43.233664 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:16:43.348744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:43.809306 run create_hlr_db(pid=6986): Launched 12:16:43.931295 bus /sierra_2: Setting Powered False 12:16:44.991185 run create_hlr_db(pid=6986): Terminated: ok {rc=0} 12:16:45.426050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Launched 12:16:45.745441 run osmo-hlr_10.42.42.2(pid=6989): Launched 12:16:45.900696 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:46.542430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Launched 12:16:46.871159 run osmo-stp_10.42.42.5(pid=6992): Launched 12:16:47.120190 run osmo-msc_10.42.42.6: Starting osmo-msc 12:16:47.760214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Launched 12:16:48.079577 run osmo-msc_10.42.42.6(pid=6995): Launched 12:16:48.258315 run osmo-stp_10.42.42.5(pid=6992): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] 12:16:48.392608 run osmo-stp_10.42.42.5(pid=6992): stdout: | (launched: 2022-12-10_12:16:46.805822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:48.528635 run osmo-stp_10.42.42.5(pid=6992): stderr: | 20221210121647104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121647104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121647104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121647105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121647105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121647105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121647105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:48.662667 run osmo-stp_10.42.42.5(pid=6992): stdout: | (launched: 2022-12-10_12:16:46.805822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:48.790306 run osmo-stp_10.42.42.5(pid=6992): stderr: | 20221210121647104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121647104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121647104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121647105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121647105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121647105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121647105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:48.942757 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6992): Process ended prematurely: osmo-stp_10.42.42.5(pid=6992) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:16:48.952361 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:16:48.979776 run osmo-hlr_10.42.42.2(pid=6989): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6989)] 12:16:49.029770 run osmo-hlr_10.42.42.2(pid=6989): stdout: | (launched: 2022-12-10_12:16:45.687815) 12:16:49.080816 run osmo-hlr_10.42.42.2(pid=6989): stderr: | 20221210121645924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121645924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121645924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121645924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121645924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121645924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121645945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121645957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121645958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121645958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:49.152559 run osmo-msc_10.42.42.6(pid=6995): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6995)] 12:16:49.202502 run osmo-msc_10.42.42.6(pid=6995): stdout: | (launched: 2022-12-10_12:16:48.021864) 12:16:49.254871 run osmo-msc_10.42.42.6(pid=6995): stderr: | 20221210121648342 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121648342 DLGLOBAL DEBUG validating counter group 0x7ff1fa5bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121648342 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121648342 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121648342 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121648343 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121648345 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121648345 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121648345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121648345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:16:49.306637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Terminating (SIGTERM) 12:16:49.348688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Terminating (SIGTERM) 12:16:49.391013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Terminating (SIGTERM) 12:16:49.433247 --- ParallelTerminationStrategy: PID 6988 died... 12:16:49.453542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Terminated: ok {rc=0} 12:16:49.499977 --- ParallelTerminationStrategy: PID 6991 died... 12:16:49.519368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Terminated: ok {rc=0} 12:16:49.565578 --- ParallelTerminationStrategy: PID 6994 died... 12:16:49.584906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Terminated: ok {rc=0} 12:16:49.673071 bus /sierra_3: Setting Powered False 12:16:50.769444 bus /sierra_3: Setting Powered False 12:16:51.887165 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:16:53.124655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:16:53.131607 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:16:53.154716 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:16:53.181418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:16:53.234615 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:16:53.258306 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:16:53.284338 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:16:53.832907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:16:53.880195 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:16:53.891247 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:16:53.949498 tst mo_mt_call.py: using LAC 28336 12:16:54.076139 tst mo_mt_call.py: using RAC 31 12:16:54.201732 tst mo_mt_call.py: using CellId 28336 12:16:54.326865 tst mo_mt_call.py: using BVCI 28337 12:16:54.443963 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:16:54.455938 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:16:54.467381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:16:54.479210 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:16:54.491004 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:16:54.502798 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:16:54.618708 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:16:54.735781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:55.229289 run create_hlr_db(pid=7000): Launched 12:16:55.350884 bus /sierra_2: Setting Powered False 12:16:56.414333 run create_hlr_db(pid=7000): Terminated: ok {rc=0} 12:16:56.857087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7002): Launched 12:16:57.175170 run osmo-hlr_10.42.42.2(pid=7003): Launched 12:16:57.297089 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:57.847049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7005): Launched 12:16:58.164599 run osmo-stp_10.42.42.5(pid=7006): Launched 12:16:58.286570 run osmo-msc_10.42.42.6: Starting osmo-msc 12:16:58.862974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7008): Launched 12:16:59.183068 run osmo-msc_10.42.42.6(pid=7009): Launched 12:16:59.360657 run osmo-stp_10.42.42.5(pid=7006): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7006)] 12:16:59.495611 run osmo-stp_10.42.42.5(pid=7006): stdout: | (launched: 2022-12-10_12:16:58.107086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:59.630941 run osmo-stp_10.42.42.5(pid=7006): stderr: | 20221210121658298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121658298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121658298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121658299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121658299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121658299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121658299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:59.765357 run osmo-stp_10.42.42.5(pid=7006): stdout: | (launched: 2022-12-10_12:16:58.107086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:59.892575 run osmo-stp_10.42.42.5(pid=7006): stderr: | 20221210121658298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121658298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121658298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121658299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121658299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121658299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121658299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:00.045095 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7006): Process ended prematurely: osmo-stp_10.42.42.5(pid=7006) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7006)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:17:00.054504 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:17:00.082727 run osmo-hlr_10.42.42.2(pid=7003): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7003)] 12:17:00.132855 run osmo-hlr_10.42.42.2(pid=7003): stdout: | (launched: 2022-12-10_12:16:57.117501) 12:17:00.184699 run osmo-hlr_10.42.42.2(pid=7003): stderr: | 20221210121657315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121657315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121657315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121657315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121657315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121657315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121657328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121657336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121657336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121657336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:00.257167 run osmo-msc_10.42.42.6(pid=7009): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7009)] 12:17:00.307202 run osmo-msc_10.42.42.6(pid=7009): stdout: | (launched: 2022-12-10_12:16:59.124446) 12:17:00.358953 run osmo-msc_10.42.42.6(pid=7009): stderr: | 20221210121659444 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121659444 DLGLOBAL DEBUG validating counter group 0x7f9b60478c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121659444 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121659444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121659445 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121659445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121659448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121659449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121659449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121659449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:17:00.411359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7002): Terminating (SIGTERM) 12:17:00.452754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7005): Terminating (SIGTERM) 12:17:00.494858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7008): Terminating (SIGTERM) 12:17:00.536743 --- ParallelTerminationStrategy: PID 7002 died... 12:17:00.556612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7002): Terminated: ok {rc=0} 12:17:00.602994 --- ParallelTerminationStrategy: PID 7005 died... 12:17:00.622444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7005): Terminated: ok {rc=0} 12:17:00.668709 --- ParallelTerminationStrategy: PID 7008 died... 12:17:00.688186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7008): Terminated: ok {rc=0} 12:17:00.776346 bus /sierra_3: Setting Powered False 12:17:01.877191 bus /sierra_3: Setting Powered False 12:17:02.991517 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:17:04.140017 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:17:04.152203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:17:04.217911 tst mo_mt_call_osmux.py: using LAC 28337 12:17:04.342633 tst mo_mt_call_osmux.py: using RAC 32 12:17:04.466106 tst mo_mt_call_osmux.py: using CellId 28337 12:17:04.593443 tst mo_mt_call_osmux.py: using BVCI 28338 12:17:04.710688 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:17:04.722274 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:17:04.733675 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:17:04.745760 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:17:04.758585 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:17:04.769888 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:17:04.886840 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:17:05.004588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:05.498081 run create_hlr_db(pid=7014): Launched 12:17:05.620221 bus /sierra_2: Setting Powered False 12:17:06.684070 run create_hlr_db(pid=7014): Terminated: ok {rc=0} 12:17:07.127336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7016): Launched 12:17:07.446595 run osmo-hlr_10.42.42.2(pid=7017): Launched 12:17:07.569389 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:08.118298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7019): Launched 12:17:08.435575 run osmo-stp_10.42.42.5(pid=7020): Launched 12:17:08.557281 run osmo-msc_10.42.42.6: Starting osmo-msc 12:17:09.135269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7022): Launched 12:17:09.454868 run osmo-msc_10.42.42.6(pid=7023): Launched 12:17:09.634187 run osmo-stp_10.42.42.5(pid=7020): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7020)] 12:17:09.769323 run osmo-stp_10.42.42.5(pid=7020): stdout: | (launched: 2022-12-10_12:17:08.378074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:09.905670 run osmo-stp_10.42.42.5(pid=7020): stderr: | 20221210121708570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121708570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121708571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121708571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121708571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121708572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121708572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:10.039747 run osmo-stp_10.42.42.5(pid=7020): stdout: | (launched: 2022-12-10_12:17:08.378074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:10.167371 run osmo-stp_10.42.42.5(pid=7020): stderr: | 20221210121708570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121708570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121708571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121708571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121708571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121708572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121708572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:10.320009 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7020): Process ended prematurely: osmo-stp_10.42.42.5(pid=7020) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7020)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:17:10.329542 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:17:10.357609 run osmo-hlr_10.42.42.2(pid=7017): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7017)] 12:17:10.407436 run osmo-hlr_10.42.42.2(pid=7017): stdout: | (launched: 2022-12-10_12:17:07.388715) 12:17:10.459224 run osmo-hlr_10.42.42.2(pid=7017): stderr: | 20221210121707586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121707586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121707586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121707586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121707586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121707586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121707596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121707605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121707605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121707605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:10.531106 run osmo-msc_10.42.42.6(pid=7023): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7023)] 12:17:10.580899 run osmo-msc_10.42.42.6(pid=7023): stdout: | (launched: 2022-12-10_12:17:09.397041) 12:17:10.632226 run osmo-msc_10.42.42.6(pid=7023): stderr: | 20221210121709716 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121709716 DLGLOBAL DEBUG validating counter group 0x7f561aa55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121709716 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121709716 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121709716 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121709716 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121709718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121709718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121709718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121709719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:17:10.684066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7016): Terminating (SIGTERM) 12:17:10.725766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7019): Terminating (SIGTERM) 12:17:10.767217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7022): Terminating (SIGTERM) 12:17:10.809170 --- ParallelTerminationStrategy: PID 7016 died... 12:17:10.828825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7016): Terminated: ok {rc=0} 12:17:10.874960 --- ParallelTerminationStrategy: PID 7019 died... 12:17:10.894273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7019): Terminated: ok {rc=0} 12:17:10.940074 --- ParallelTerminationStrategy: PID 7022 died... 12:17:10.959370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7022): Terminated: ok {rc=0} 12:17:11.046538 bus /sierra_3: Setting Powered False 12:17:12.145063 bus /sierra_3: Setting Powered False 12:17:13.262442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:17:14.496713 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:17:14.503827 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:17:14.526956 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:17:14.552684 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:17:14.603241 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:17:14.626249 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:17:14.652014 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:17:15.206778 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:17:15.255565 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:15.266617 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:17:15.323933 tst mo_mt_call.py: using LAC 28338 12:17:15.441730 tst mo_mt_call.py: using RAC 33 12:17:15.557821 tst mo_mt_call.py: using CellId 28338 12:17:15.682671 tst mo_mt_call.py: using BVCI 28339 12:17:15.798446 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:15.810139 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:15.821679 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:15.839210 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:15.859267 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:15.873393 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:17:16.022544 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:17:16.170909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:16.709760 run create_hlr_db(pid=7028): Launched 12:17:16.862450 bus /sierra_2: Setting Powered False 12:17:17.922216 run create_hlr_db(pid=7028): Terminated: ok {rc=0} 12:17:18.361626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7030): Launched 12:17:18.679650 run osmo-hlr_10.42.42.2(pid=7031): Launched 12:17:18.800225 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:19.348819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7033): Launched 12:17:19.667695 run osmo-stp_10.42.42.5(pid=7034): Launched 12:17:19.789693 run osmo-msc_10.42.42.6: Starting osmo-msc 12:17:20.363468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7036): Launched 12:17:20.683314 run osmo-msc_10.42.42.6(pid=7037): Launched 12:17:20.860437 run osmo-stp_10.42.42.5(pid=7034): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7034)] 12:17:20.995290 run osmo-stp_10.42.42.5(pid=7034): stdout: | (launched: 2022-12-10_12:17:19.610051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:21.130205 run osmo-stp_10.42.42.5(pid=7034): stderr: | 20221210121719800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121719800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121719800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121719801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121719803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121719803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121719803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:21.264630 run osmo-stp_10.42.42.5(pid=7034): stdout: | (launched: 2022-12-10_12:17:19.610051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:21.391909 run osmo-stp_10.42.42.5(pid=7034): stderr: | 20221210121719800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121719800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121719800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121719801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121719803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121719803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121719803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:21.545037 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7034): Process ended prematurely: osmo-stp_10.42.42.5(pid=7034) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7034)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:17:21.554582 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:17:21.583051 run osmo-hlr_10.42.42.2(pid=7031): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7031)] 12:17:21.633126 run osmo-hlr_10.42.42.2(pid=7031): stdout: | (launched: 2022-12-10_12:17:18.622293) 12:17:21.684827 run osmo-hlr_10.42.42.2(pid=7031): stderr: | 20221210121718820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121718820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121718820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121718820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121718820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121718821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121718834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121718842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121718842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121718842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:21.756563 run osmo-msc_10.42.42.6(pid=7037): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7037)] 12:17:21.806438 run osmo-msc_10.42.42.6(pid=7037): stdout: | (launched: 2022-12-10_12:17:20.624362) 12:17:21.857739 run osmo-msc_10.42.42.6(pid=7037): stderr: | 20221210121720944 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121720944 DLGLOBAL DEBUG validating counter group 0x7f3c6dabac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121720944 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121720945 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121720945 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121720945 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121720947 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121720947 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121720947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121720947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:17:21.909701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7030): Terminating (SIGTERM) 12:17:21.951236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7033): Terminating (SIGTERM) 12:17:21.993029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7036): Terminating (SIGTERM) 12:17:22.034993 --- ParallelTerminationStrategy: PID 7030 died... 12:17:22.054965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7030): Terminated: ok {rc=0} 12:17:22.101608 --- ParallelTerminationStrategy: PID 7033 died... 12:17:22.121156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7033): Terminated: ok {rc=0} 12:17:22.167438 --- ParallelTerminationStrategy: PID 7036 died... 12:17:22.186982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7036): Terminated: ok {rc=0} 12:17:22.274608 bus /sierra_3: Setting Powered False 12:17:23.373325 bus /sierra_3: Setting Powered False 12:17:24.488597 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:17:25.637789 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:25.650169 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:17:25.711751 tst mo_mt_call_osmux.py: using LAC 28339 12:17:25.836076 tst mo_mt_call_osmux.py: using RAC 34 12:17:25.959521 tst mo_mt_call_osmux.py: using CellId 28339 12:17:26.088090 tst mo_mt_call_osmux.py: using BVCI 28340 12:17:26.203065 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:26.214562 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:26.226027 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:26.237465 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:26.249050 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:17:26.260493 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:17:26.375245 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:17:26.490932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:26.952423 run create_hlr_db(pid=7039): Launched 12:17:27.074730 bus /sierra_2: Setting Powered False 12:17:28.134159 run create_hlr_db(pid=7039): Terminated: ok {rc=0} 12:17:28.569704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7041): Launched 12:17:28.887396 run osmo-hlr_10.42.42.2(pid=7042): Launched 12:17:29.008619 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:29.557575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7044): Launched 12:17:29.875121 run osmo-stp_10.42.42.5(pid=7045): Launched 12:17:29.996033 run osmo-msc_10.42.42.6: Starting osmo-msc 12:17:30.570974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7047): Launched 12:17:30.923237 run osmo-msc_10.42.42.6(pid=7048): Launched 12:17:31.274398 run osmo-stp_10.42.42.5(pid=7045): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7045)] 12:17:31.529587 run osmo-stp_10.42.42.5(pid=7045): stdout: | (launched: 2022-12-10_12:17:29.817503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:31.732094 run osmo-stp_10.42.42.5(pid=7045): stderr: | 20221210121730009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121730009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121730009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121730009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121730010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121730010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121730010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:31.862848 run osmo-stp_10.42.42.5(pid=7045): stdout: | (launched: 2022-12-10_12:17:29.817503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:31.987776 run osmo-stp_10.42.42.5(pid=7045): stderr: | 20221210121730009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121730009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121730009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121730009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121730010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121730010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121730010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:32.135685 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7045): Process ended prematurely: osmo-stp_10.42.42.5(pid=7045) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7045)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:17:32.145620 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:17:32.174535 run osmo-hlr_10.42.42.2(pid=7042): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7042)] 12:17:32.226574 run osmo-hlr_10.42.42.2(pid=7042): stdout: | (launched: 2022-12-10_12:17:28.829922) 12:17:32.277636 run osmo-hlr_10.42.42.2(pid=7042): stderr: | 20221210121729028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121729028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121729028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121729028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121729028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121729028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121729040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121729048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121729049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121729049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:32.349563 run osmo-msc_10.42.42.6(pid=7048): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7048)] 12:17:32.398124 run osmo-msc_10.42.42.6(pid=7048): stdout: | (launched: 2022-12-10_12:17:30.841078) 12:17:32.447046 run osmo-msc_10.42.42.6(pid=7048): stderr: | 20221210121731312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121731312 DLGLOBAL DEBUG validating counter group 0x7feff7ee7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121731315 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121731315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121731315 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121731315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121731320 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121731323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121731323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121731323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:17:32.496235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7041): Terminating (SIGTERM) 12:17:32.535732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7044): Terminating (SIGTERM) 12:17:32.575425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7047): Terminating (SIGTERM) 12:17:32.615377 --- ParallelTerminationStrategy: PID 7041 died... 12:17:32.634577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7041): Terminated: ok {rc=0} 12:17:32.679140 --- ParallelTerminationStrategy: PID 7044 died... 12:17:32.697876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7044): Terminated: ok {rc=0} 12:17:32.741720 --- ParallelTerminationStrategy: PID 7047 died... 12:17:32.760319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7047): Terminated: ok {rc=0} 12:17:32.843974 bus /sierra_3: Setting Powered False 12:17:33.941542 bus /sierra_3: Setting Powered False 12:17:35.057088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:17:36.291697 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:17:36.301165 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:17:36.326047 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:17:36.353634 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:17:36.406809 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:17:36.430964 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:17:36.458424 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:17:37.011228 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:17:37.062643 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:37.074331 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:17:37.134242 tst mo_mt_call.py: using LAC 28340 12:17:37.257925 tst mo_mt_call.py: using RAC 35 12:17:37.380644 tst mo_mt_call.py: using CellId 28340 12:17:37.506562 tst mo_mt_call.py: using BVCI 28341 12:17:37.621835 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:37.633470 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:37.644708 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:37.656256 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:37.667973 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:37.679581 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:17:37.795436 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:17:37.912876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:38.404887 run create_hlr_db(pid=7053): Launched 12:17:38.526882 bus /sierra_2: Setting Powered False 12:17:39.591364 run create_hlr_db(pid=7053): Terminated: ok {rc=0} 12:17:40.017151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7055): Launched 12:17:40.314806 run osmo-hlr_10.42.42.2(pid=7056): Launched 12:17:40.428330 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:40.938411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7058): Launched 12:17:41.233914 run osmo-stp_10.42.42.5(pid=7059): Launched 12:17:41.347069 run osmo-msc_10.42.42.6: Starting osmo-msc 12:17:41.885630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7061): Launched 12:17:42.184332 run osmo-msc_10.42.42.6(pid=7062): Launched 12:17:42.351075 run osmo-stp_10.42.42.5(pid=7059): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7059)] 12:17:42.479436 run osmo-stp_10.42.42.5(pid=7059): stdout: | (launched: 2022-12-10_12:17:41.179553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:42.604935 run osmo-stp_10.42.42.5(pid=7059): stderr: | 20221210121741349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121741349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121741349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121741350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121741350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121741350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121741350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:42.728591 run osmo-stp_10.42.42.5(pid=7059): stdout: | (launched: 2022-12-10_12:17:41.179553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:42.847029 run osmo-stp_10.42.42.5(pid=7059): stderr: | 20221210121741349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121741349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121741349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121741350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121741350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121741350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121741350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:42.989225 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7059): Process ended prematurely: osmo-stp_10.42.42.5(pid=7059) [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7059)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:17:42.998200 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:17:43.024079 run osmo-hlr_10.42.42.2(pid=7056): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7056)] 12:17:43.071079 run osmo-hlr_10.42.42.2(pid=7056): stdout: | (launched: 2022-12-10_12:17:40.260599) 12:17:43.119711 run osmo-hlr_10.42.42.2(pid=7056): stderr: | 20221210121740436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121740436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121740436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121740436 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121740436 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121740436 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121740451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121740461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121740461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121740462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:43.187719 run osmo-msc_10.42.42.6(pid=7062): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7062)] 12:17:43.234320 run osmo-msc_10.42.42.6(pid=7062): stdout: | (launched: 2022-12-10_12:17:42.129188) 12:17:43.282476 run osmo-msc_10.42.42.6(pid=7062): stderr: | 20221210121742398 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121742398 DLGLOBAL DEBUG validating counter group 0x7f9cf7006c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121742399 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121742399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121742399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121742399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121742402 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121742402 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121742402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121742402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:17:43.331102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7055): Terminating (SIGTERM) 12:17:43.370120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7058): Terminating (SIGTERM) 12:17:43.409100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7061): Terminating (SIGTERM) 12:17:43.448338 --- ParallelTerminationStrategy: PID 7055 died... 12:17:43.467231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7055): Terminated: ok {rc=0} 12:17:43.510742 --- ParallelTerminationStrategy: PID 7058 died... 12:17:43.529257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7058): Terminated: ok {rc=0} 12:17:43.572492 --- ParallelTerminationStrategy: PID 7061 died... 12:17:43.590940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7061): Terminated: ok {rc=0} 12:17:43.675792 bus /sierra_3: Setting Powered False 12:17:44.774093 bus /sierra_3: Setting Powered False 12:17:45.903783 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:17:47.089026 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:47.104346 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:17:47.171967 tst mo_mt_call_osmux.py: using LAC 28341 12:17:47.294354 tst mo_mt_call_osmux.py: using RAC 36 12:17:47.408182 tst mo_mt_call_osmux.py: using CellId 28341 12:17:47.522268 tst mo_mt_call_osmux.py: using BVCI 28342 12:17:47.630002 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:47.641063 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:47.651937 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:47.662868 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:47.673819 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:17:47.684617 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:17:47.796942 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:17:47.916314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:48.408852 run create_hlr_db(pid=7064): Launched 12:17:48.530999 bus /sierra_2: Setting Powered False 12:17:49.595128 run create_hlr_db(pid=7064): Terminated: ok {rc=0} 12:17:50.019275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7066): Launched 12:17:50.315432 run osmo-hlr_10.42.42.2(pid=7067): Launched 12:17:50.428221 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:50.937373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7069): Launched 12:17:51.233712 run osmo-stp_10.42.42.5(pid=7070): Launched 12:17:51.347079 run osmo-msc_10.42.42.6: Starting osmo-msc 12:17:51.882705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7072): Launched 12:17:52.182006 run osmo-msc_10.42.42.6(pid=7073): Launched 12:17:52.348449 run osmo-stp_10.42.42.5(pid=7070): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7070)] 12:17:52.474984 run osmo-stp_10.42.42.5(pid=7070): stdout: | (launched: 2022-12-10_12:17:51.179758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:52.600085 run osmo-stp_10.42.42.5(pid=7070): stderr: | 20221210121751350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121751350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121751350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121751351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121751351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121751351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121751351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:52.723928 run osmo-stp_10.42.42.5(pid=7070): stdout: | (launched: 2022-12-10_12:17:51.179758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:52.842624 run osmo-stp_10.42.42.5(pid=7070): stderr: | 20221210121751350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121751350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121751350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121751351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121751351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121751351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121751351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:52.984390 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7070): Process ended prematurely: osmo-stp_10.42.42.5(pid=7070) [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7070)] [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:17:52.993305 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:17:53.019547 run osmo-hlr_10.42.42.2(pid=7067): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7067)] 12:17:53.066461 run osmo-hlr_10.42.42.2(pid=7067): stdout: | (launched: 2022-12-10_12:17:50.261265) 12:17:53.115101 run osmo-hlr_10.42.42.2(pid=7067): stderr: | 20221210121750437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121750437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121750437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121750437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121750437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121750437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121750449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121750458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121750458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121750458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:53.183122 run osmo-msc_10.42.42.6(pid=7073): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7073)] 12:17:53.230045 run osmo-msc_10.42.42.6(pid=7073): stdout: | (launched: 2022-12-10_12:17:52.125953) 12:17:53.278567 run osmo-msc_10.42.42.6(pid=7073): stderr: | 20221210121752395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121752395 DLGLOBAL DEBUG validating counter group 0x7fe3b83fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121752395 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121752395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121752396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121752396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121752399 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121752399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121752399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121752399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:17:53.327452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7066): Terminating (SIGTERM) 12:17:53.366380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7069): Terminating (SIGTERM) 12:17:53.405088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7072): Terminating (SIGTERM) 12:17:53.444177 --- ParallelTerminationStrategy: PID 7066 died... 12:17:53.463080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7066): Terminated: ok {rc=0} 12:17:53.506627 --- ParallelTerminationStrategy: PID 7069 died... 12:17:53.525175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7069): Terminated: ok {rc=0} 12:17:53.568194 --- ParallelTerminationStrategy: PID 7072 died... 12:17:53.586737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7072): Terminated: ok {rc=0} 12:17:53.668936 bus /sierra_3: Setting Powered False 12:17:54.762594 bus /sierra_3: Setting Powered False 12:17:55.876286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:nanobts+band-1900 --------------------------------------------------------------------- 12:17:57.115220 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:17:57.120123 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:17:57.143257 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:17:57.169155 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:17:57.251878 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:17:57.275276 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:17:57.301251 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:17:57.884219 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 12:17:57.889099 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:17:57.899609 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:17:57.938761 tst emergency_mo_mt_call.py: using LAC 28342 12:17:58.053402 tst emergency_mo_mt_call.py: using RAC 37 12:17:58.167142 tst emergency_mo_mt_call.py: using CellId 28342 12:17:58.291852 tst emergency_mo_mt_call.py: using BVCI 28343 12:17:58.407262 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:17:58.418608 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:17:58.429797 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:17:58.441362 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:17:58.452694 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:17:58.464171 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:17:58.578336 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:17:58.690145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:59.143971 run create_hlr_db(pid=7079): Launched 12:17:59.265698 bus /sierra_2: Setting Powered False 12:18:00.328243 run create_hlr_db(pid=7079): Terminated: ok {rc=0} 12:18:00.765074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7081): Launched 12:18:01.114452 run osmo-hlr_10.42.42.2(pid=7082): Launched 12:18:01.326259 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:02.100016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7084): Launched 12:18:02.405078 run osmo-stp_10.42.42.5(pid=7085): Launched 12:18:02.525678 tst emergency_mo_mt_call.py: using MSISDN 7726 12:18:02.674084 run osmo-msc_10.42.42.6: Starting osmo-msc 12:18:03.197609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7087): Launched 12:18:03.489523 run osmo-msc_10.42.42.6(pid=7088): Launched 12:18:03.654633 run osmo-stp_10.42.42.5(pid=7085): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7085)] 12:18:03.778502 run osmo-stp_10.42.42.5(pid=7085): stdout: | (launched: 2022-12-10_12:18:02.350999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:03.902981 run osmo-stp_10.42.42.5(pid=7085): stderr: | 20221210121802520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121802520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121802520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121802521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121802521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121802521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121802521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:04.024387 run osmo-stp_10.42.42.5(pid=7085): stdout: | (launched: 2022-12-10_12:18:02.350999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:04.141212 run osmo-stp_10.42.42.5(pid=7085): stderr: | 20221210121802520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121802520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121802520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121802521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121802521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121802521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121802521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:04.281263 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7085): Process ended prematurely: osmo-stp_10.42.42.5(pid=7085) [trial-2374↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7085)] [trial-2374↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 12:18:04.289571 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 12:18:04.315337 run osmo-hlr_10.42.42.2(pid=7082): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7082)] 12:18:04.362367 run osmo-hlr_10.42.42.2(pid=7082): stdout: | (launched: 2022-12-10_12:18:01.050193) 12:18:04.411252 run osmo-hlr_10.42.42.2(pid=7082): stderr: | 20221210121801513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121801515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121801515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121801515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121801515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121801515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121801536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121801553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121801553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121801553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:04.479571 run osmo-msc_10.42.42.6(pid=7088): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7088)] 12:18:04.526454 run osmo-msc_10.42.42.6(pid=7088): stdout: | (launched: 2022-12-10_12:18:03.435746) 12:18:04.575024 run osmo-msc_10.42.42.6(pid=7088): stderr: | 20221210121803707 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121803707 DLGLOBAL DEBUG validating counter group 0x7f9fe5dbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121803707 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121803707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121803707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121803707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121803709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121803710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121803710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121803710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:18:04.623933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7081): Terminating (SIGTERM) 12:18:04.663427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7084): Terminating (SIGTERM) 12:18:04.702759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7087): Terminating (SIGTERM) 12:18:04.742035 --- ParallelTerminationStrategy: PID 7081 died... 12:18:04.760850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7081): Terminated: ok {rc=0} 12:18:04.804426 --- ParallelTerminationStrategy: PID 7084 died... 12:18:04.823104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7084): Terminated: ok {rc=0} 12:18:04.866839 --- ParallelTerminationStrategy: PID 7087 died... 12:18:04.885569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7087): Terminated: ok {rc=0} 12:18:04.970449 bus /sierra_3: Setting Powered False 12:18:06.071088 bus /sierra_3: Setting Powered False 12:18:07.186458 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 12:18:08.274618 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:18:08.286081 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:18:08.326929 tst emergency_preemptive_call.py: using LAC 28343 12:18:08.442370 tst emergency_preemptive_call.py: using RAC 38 12:18:08.556744 tst emergency_preemptive_call.py: using CellId 28343 12:18:08.670289 tst emergency_preemptive_call.py: using BVCI 28344 12:18:08.777170 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:18:08.787626 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:18:08.798144 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:18:08.808487 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:18:08.819032 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:18:08.829423 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:08.941209 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:09.058423 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:09.171270 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:09.287760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:09.745544 run create_hlr_db(pid=7090): Launched 12:18:09.865207 bus /sierra_2: Setting Powered False 12:18:10.923908 run create_hlr_db(pid=7090): Terminated: ok {rc=0} 12:18:11.332005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7092): Launched 12:18:11.623834 run osmo-hlr_10.42.42.2(pid=7093): Launched 12:18:11.735062 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:12.277652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7095): Launched 12:18:12.592358 run osmo-stp_10.42.42.5(pid=7096): Launched 12:18:12.723478 tst emergency_preemptive_call.py: using MSISDN 7727 12:18:12.885348 run osmo-msc_10.42.42.6: Starting osmo-msc 12:18:13.448626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7098): Launched 12:18:13.761280 run osmo-msc_10.42.42.6(pid=7099): Launched 12:18:13.936162 run osmo-stp_10.42.42.5(pid=7096): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7096)] 12:18:14.069272 run osmo-stp_10.42.42.5(pid=7096): stdout: | (launched: 2022-12-10_12:18:12.534932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:14.202585 run osmo-stp_10.42.42.5(pid=7096): stderr: | 20221210121812725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121812725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121812725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121812726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121812726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121812726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121812726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:14.335466 run osmo-stp_10.42.42.5(pid=7096): stdout: | (launched: 2022-12-10_12:18:12.534932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:14.461347 run osmo-stp_10.42.42.5(pid=7096): stderr: | 20221210121812725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121812725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121812725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121812726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121812726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121812726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121812726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:14.612009 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7096): Process ended prematurely: osmo-stp_10.42.42.5(pid=7096) [trial-2374↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7096)] [trial-2374↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 12:18:14.621030 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 12:18:14.649396 run osmo-hlr_10.42.42.2(pid=7093): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7093)] 12:18:14.699517 run osmo-hlr_10.42.42.2(pid=7093): stdout: | (launched: 2022-12-10_12:18:11.570276) 12:18:14.751204 run osmo-hlr_10.42.42.2(pid=7093): stderr: | 20221210121811746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121811746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121811746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121811746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121811746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121811746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121811758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121811766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121811767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121811767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:14.823203 run osmo-msc_10.42.42.6(pid=7099): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7099)] 12:18:14.873258 run osmo-msc_10.42.42.6(pid=7099): stdout: | (launched: 2022-12-10_12:18:13.704318) 12:18:14.924931 run osmo-msc_10.42.42.6(pid=7099): stderr: | 20221210121814024 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210121814025 DLGLOBAL DEBUG validating counter group 0x7f14c75f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210121814025 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210121814025 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210121814025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210121814025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210121814027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210121814027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210121814027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210121814028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:18:14.977209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7092): Terminating (SIGTERM) 12:18:15.018994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7095): Terminating (SIGTERM) 12:18:15.061061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7098): Terminating (SIGTERM) 12:18:15.103467 --- ParallelTerminationStrategy: PID 7092 died... 12:18:15.123367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7092): Terminated: ok {rc=0} 12:18:15.170329 --- ParallelTerminationStrategy: PID 7095 died... 12:18:15.190025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7095): Terminated: ok {rc=0} 12:18:15.236532 --- ParallelTerminationStrategy: PID 7098 died... 12:18:15.256145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7098): Terminated: ok {rc=0} 12:18:15.344144 bus /sierra_9: Setting Powered False 12:18:16.442081 bus /sierra_9: Setting Powered False 12:18:17.558499 bus /sierra_8: Setting Powered False 12:18:18.656703 bus /sierra_8: Setting Powered False 12:18:19.771527 bus /sierra_3: Setting Powered False 12:18:20.870508 bus /sierra_3: Setting Powered False 12:18:21.986531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-1900 --------------------------------------------------------------------- 12:18:23.252862 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:23.257884 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:18:23.281026 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 12:18:23.318191 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:18:23.402651 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:18:23.426575 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 12:18:23.463552 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:18:24.053096 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 12:18:24.101454 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.111880 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:18:24.149718 tst cs_paging_gprs_active.py: using LAC 28344 12:18:24.268831 tst cs_paging_gprs_active.py: using RAC 39 12:18:24.388299 tst cs_paging_gprs_active.py: using CellId 28344 12:18:24.505398 tst cs_paging_gprs_active.py: using BVCI 28345 12:18:24.612536 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.623077 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.633399 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.643646 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.653965 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.664126 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.674524 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.684785 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:24.695121 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:24.812162 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:24.928277 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:18:25.129165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:25.427270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7104): Launched 12:18:25.685732 run iperf3-srv_10.42.42.10(pid=7105): Launched 12:18:25.796858 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:18:25.995187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:26.292005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7106): Launched 12:18:26.550839 run iperf3-srv_10.42.42.10(pid=7107): Launched 12:18:26.661785 tst cs_paging_gprs_active.py:38: start network... 12:18:26.860399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:27.318565 run create_hlr_db(pid=7108): Launched 12:18:27.441138 bus /sierra_2: Setting Powered False 12:18:28.501228 run create_hlr_db(pid=7108): Terminated: ok {rc=0} 12:18:28.914189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7110): Launched 12:18:29.210460 run osmo-hlr_10.42.42.2(pid=7111): Launched 12:18:29.323569 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:29.832686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7113): Launched 12:18:30.129602 run osmo-stp_10.42.42.5(pid=7114): Launched 12:18:30.243335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:30.756364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7116): Launched 12:18:30.896546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:31.168327 run patchelf(pid=7117): Launched 12:18:31.348309 run osmo-stp_10.42.42.5(pid=7114): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7114)] 12:18:31.476679 run osmo-stp_10.42.42.5(pid=7114): stdout: | (launched: 2022-12-10_12:18:30.075288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:31.606481 run osmo-stp_10.42.42.5(pid=7114): stderr: | 20221210121830242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121830242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121830243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121830243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121830243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121830244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121830244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:31.736107 run osmo-stp_10.42.42.5(pid=7114): stdout: | (launched: 2022-12-10_12:18:30.075288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:31.860206 run osmo-stp_10.42.42.5(pid=7114): stderr: | 20221210121830242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121830242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121830243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121830243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121830243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121830244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121830244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:32.007934 run patchelf(pid=7117): Terminating (SIGINT) 12:18:32.177755 run patchelf(pid=7117): Terminated: ok {rc=0} 12:18:32.298491 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7114): Process ended prematurely: osmo-stp_10.42.42.5(pid=7114) [trial-2374↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7114)] [trial-2374↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 12:18:32.307814 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 12:18:32.334833 run osmo-hlr_10.42.42.2(pid=7111): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7111)] 12:18:32.382229 run osmo-hlr_10.42.42.2(pid=7111): stdout: | (launched: 2022-12-10_12:18:29.156137) 12:18:32.431152 run osmo-hlr_10.42.42.2(pid=7111): stderr: | 20221210121829329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121829329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121829329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121829329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121829329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121829329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121829346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121829356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121829356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121829356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:32.481098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7104): Terminating (SIGTERM) 12:18:32.520473 run iperf3-srv_10.42.42.10(pid=7105): Terminating (SIGTERM) 12:18:32.559665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7106): Terminating (SIGTERM) 12:18:32.598989 run iperf3-srv_10.42.42.10(pid=7107): Terminating (SIGTERM) 12:18:32.638141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7110): Terminating (SIGTERM) 12:18:32.677385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7113): Terminating (SIGTERM) 12:18:32.716515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7116): Terminating (SIGTERM) 12:18:32.755804 --- ParallelTerminationStrategy: PID 7104 died... 12:18:32.774712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7104): Terminated: ok {rc=0} 12:18:32.818653 --- ParallelTerminationStrategy: PID 7105 died... 12:18:32.836902 run iperf3-srv_10.42.42.10(pid=7105): Terminated {rc=256} 12:18:32.880374 --- ParallelTerminationStrategy: PID 7106 died... 12:18:32.898788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7106): Terminated: ok {rc=0} 12:18:32.942148 --- ParallelTerminationStrategy: PID 7107 died... 12:18:32.960425 run iperf3-srv_10.42.42.10(pid=7107): Terminated {rc=256} 12:18:33.003677 --- ParallelTerminationStrategy: PID 7110 died... 12:18:33.022094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7110): Terminated: ok {rc=0} 12:18:33.065390 --- ParallelTerminationStrategy: PID 7113 died... 12:18:33.083738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7113): Terminated: ok {rc=0} 12:18:33.126958 --- ParallelTerminationStrategy: PID 7116 died... 12:18:33.145370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7116): Terminated: ok {rc=0} 12:18:33.228759 bus /gobi_0: Setting Powered False 12:18:34.325427 bus /gobi_0: Setting Powered False 12:18:35.440703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 12:18:36.584735 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:36.596026 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:18:36.634426 tst iperf3.py: using LAC 28345 12:18:36.751609 tst iperf3.py: using RAC 40 12:18:36.869150 tst iperf3.py: using CellId 28345 12:18:36.986471 tst iperf3.py: using BVCI 28346 12:18:37.093663 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.104236 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.114677 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.124921 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.135233 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.145468 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.155827 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.166098 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:37.176445 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:37.292588 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:18:37.492280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:37.791210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7118): Launched 12:18:38.050416 run iperf3-srv_10.42.42.10(pid=7119): Launched 12:18:38.162398 tst iperf3.py:8: start network... 12:18:38.361683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:38.822209 run create_hlr_db(pid=7120): Launched 12:18:38.944578 bus /gobi_6: Setting Powered False 12:18:40.004334 run create_hlr_db(pid=7120): Terminated: ok {rc=0} 12:18:40.438686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7122): Launched 12:18:40.758627 run osmo-hlr_10.42.42.2(pid=7123): Launched 12:18:40.881343 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:41.425398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7125): Launched 12:18:41.742716 run osmo-stp_10.42.42.5(pid=7126): Launched 12:18:41.863682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:42.413774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7128): Launched 12:18:42.536457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:42.806401 run patchelf(pid=7129): Launched 12:18:42.983757 run osmo-stp_10.42.42.5(pid=7126): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7126)] 12:18:43.119142 run osmo-stp_10.42.42.5(pid=7126): stdout: | (launched: 2022-12-10_12:18:41.685368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:43.255669 run osmo-stp_10.42.42.5(pid=7126): stderr: | 20221210121841875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121841875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121841876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121841876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121841877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121841877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121841877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:43.392369 run osmo-stp_10.42.42.5(pid=7126): stdout: | (launched: 2022-12-10_12:18:41.685368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:43.523428 run osmo-stp_10.42.42.5(pid=7126): stderr: | 20221210121841875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121841875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121841876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121841876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121841877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121841877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121841877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:43.678547 run patchelf(pid=7129): Terminating (SIGINT) 12:18:43.857531 run patchelf(pid=7129): Terminated: ok {rc=0} 12:18:43.986513 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7126): Process ended prematurely: osmo-stp_10.42.42.5(pid=7126) [trial-2374↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7126)] [trial-2374↪gprs:nanobts+band-1900↪iperf3.py:8] 12:18:43.996536 tst iperf3.py:8: Test FAILED (7.4 sec) 12:18:44.025592 run osmo-hlr_10.42.42.2(pid=7123): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7123)] 12:18:44.075782 run osmo-hlr_10.42.42.2(pid=7123): stdout: | (launched: 2022-12-10_12:18:40.701112) 12:18:44.127549 run osmo-hlr_10.42.42.2(pid=7123): stderr: | 20221210121840898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121840898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121840898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121840898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121840898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121840898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121840910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121840918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121840919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121840919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:44.179785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7118): Terminating (SIGTERM) 12:18:44.221793 run iperf3-srv_10.42.42.10(pid=7119): Terminating (SIGTERM) 12:18:44.263693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7122): Terminating (SIGTERM) 12:18:44.305731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7125): Terminating (SIGTERM) 12:18:44.347687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7128): Terminating (SIGTERM) 12:18:44.390005 --- ParallelTerminationStrategy: PID 7118 died... 12:18:44.409943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7118): Terminated: ok {rc=0} 12:18:44.456640 --- ParallelTerminationStrategy: PID 7119 died... 12:18:44.475987 run iperf3-srv_10.42.42.10(pid=7119): Terminated {rc=256} 12:18:44.522923 --- ParallelTerminationStrategy: PID 7122 died... 12:18:44.542488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7122): Terminated: ok {rc=0} 12:18:44.588920 --- ParallelTerminationStrategy: PID 7125 died... 12:18:44.608634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7125): Terminated: ok {rc=0} 12:18:44.654909 --- ParallelTerminationStrategy: PID 7128 died... 12:18:44.674628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7128): Terminated: ok {rc=0} 12:18:44.763072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 12:18:45.929387 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:45.941653 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:18:45.983076 tst iperf3m4.py: using LAC 28346 12:18:46.133295 tst iperf3m4.py: using RAC 41 12:18:46.255655 tst iperf3m4.py: using CellId 28346 12:18:46.385786 tst iperf3m4.py: using BVCI 28347 12:18:46.497028 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.507723 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.518447 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.529735 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.540724 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.551766 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.563071 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.574551 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:18:46.586137 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:46.702829 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:46.829854 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:46.978259 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:18:47.122952 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:18:47.370817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:47.694174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7130): Launched 12:18:47.970999 run iperf3-srv_10.42.42.10(pid=7131): Launched 12:18:48.091134 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:18:48.306516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:48.626517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7132): Launched 12:18:48.904101 run iperf3-srv_10.42.42.10(pid=7133): Launched 12:18:49.024225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:18:49.238743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:49.558256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7134): Launched 12:18:49.834462 run iperf3-srv_10.42.42.10(pid=7135): Launched 12:18:49.953432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:18:50.167358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:50.486128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7136): Launched 12:18:50.762117 run iperf3-srv_10.42.42.10(pid=7137): Launched 12:18:50.881216 tst iperf3m4.py:8: start network... 12:18:51.094855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:51.588013 run create_hlr_db(pid=7138): Launched 12:18:51.710074 bus /gobi_6: Setting Powered False 12:18:52.773133 run create_hlr_db(pid=7138): Terminated: ok {rc=0} 12:18:53.216748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7140): Launched 12:18:53.536003 run osmo-hlr_10.42.42.2(pid=7141): Launched 12:18:53.658641 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:54.210064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7143): Launched 12:18:54.529724 run osmo-stp_10.42.42.5(pid=7144): Launched 12:18:54.652555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:55.202328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7146): Launched 12:18:55.324563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:55.594475 run patchelf(pid=7147): Launched 12:18:55.763127 run osmo-stp_10.42.42.5(pid=7144): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7144)] 12:18:55.888919 run osmo-stp_10.42.42.5(pid=7144): stdout: | (launched: 2022-12-10_12:18:54.471083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:56.016906 run osmo-stp_10.42.42.5(pid=7144): stderr: | 20221210121854665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121854665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121854665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121854665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121854666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121854666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121854666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:56.144830 run osmo-stp_10.42.42.5(pid=7144): stdout: | (launched: 2022-12-10_12:18:54.471083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:56.266991 run osmo-stp_10.42.42.5(pid=7144): stderr: | 20221210121854665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121854665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121854665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121854665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121854666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121854666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121854666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:56.411664 run patchelf(pid=7147): Terminating (SIGINT) 12:18:56.579551 run patchelf(pid=7147): Terminated: ok {rc=0} 12:18:56.700715 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7144): Process ended prematurely: osmo-stp_10.42.42.5(pid=7144) [trial-2374↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7144)] [trial-2374↪gprs:nanobts+band-1900↪iperf3m4.py:8] 12:18:56.710168 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:18:56.737218 run osmo-hlr_10.42.42.2(pid=7141): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7141)] 12:18:56.784010 run osmo-hlr_10.42.42.2(pid=7141): stdout: | (launched: 2022-12-10_12:18:53.477353) 12:18:56.832729 run osmo-hlr_10.42.42.2(pid=7141): stderr: | 20221210121853678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121853678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121853678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121853678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121853678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121853678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121853691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121853702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121853702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121853702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:56.881688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7130): Terminating (SIGTERM) 12:18:56.921477 run iperf3-srv_10.42.42.10(pid=7131): Terminating (SIGTERM) 12:18:56.961047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7132): Terminating (SIGTERM) 12:18:57.000296 run iperf3-srv_10.42.42.10(pid=7133): Terminating (SIGTERM) 12:18:57.039469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7134): Terminating (SIGTERM) 12:18:57.078941 run iperf3-srv_10.42.42.10(pid=7135): Terminating (SIGTERM) 12:18:57.118126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7136): Terminating (SIGTERM) 12:18:57.157536 run iperf3-srv_10.42.42.10(pid=7137): Terminating (SIGTERM) 12:18:57.196687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7140): Terminating (SIGTERM) 12:18:57.235950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7143): Terminating (SIGTERM) 12:18:57.275133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7146): Terminating (SIGTERM) 12:18:57.314705 --- ParallelTerminationStrategy: PID 7130 died... 12:18:57.333782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7130): Terminated: ok {rc=0} 12:18:57.377926 --- ParallelTerminationStrategy: PID 7131 died... 12:18:57.396334 run iperf3-srv_10.42.42.10(pid=7131): Terminated {rc=256} 12:18:57.440172 --- ParallelTerminationStrategy: PID 7132 died... 12:18:57.458826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7132): Terminated: ok {rc=0} 12:18:57.502640 --- ParallelTerminationStrategy: PID 7133 died... 12:18:57.521092 run iperf3-srv_10.42.42.10(pid=7133): Terminated {rc=256} 12:18:57.564439 --- ParallelTerminationStrategy: PID 7134 died... 12:18:57.583037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7134): Terminated: ok {rc=0} 12:18:57.626284 --- ParallelTerminationStrategy: PID 7135 died... 12:18:57.644716 run iperf3-srv_10.42.42.10(pid=7135): Terminated {rc=256} 12:18:57.688058 --- ParallelTerminationStrategy: PID 7136 died... 12:18:57.706670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7136): Terminated: ok {rc=0} 12:18:57.750083 --- ParallelTerminationStrategy: PID 7137 died... 12:18:57.768478 run iperf3-srv_10.42.42.10(pid=7137): Terminated {rc=256} 12:18:57.811853 --- ParallelTerminationStrategy: PID 7140 died... 12:18:57.830460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7140): Terminated: ok {rc=0} 12:18:57.874208 --- ParallelTerminationStrategy: PID 7143 died... 12:18:57.892716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7143): Terminated: ok {rc=0} 12:18:57.936360 --- ParallelTerminationStrategy: PID 7146 died... 12:18:57.954841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7146): Terminated: ok {rc=0} 12:18:58.038459 bus /gobi_4: Setting Powered False 12:18:59.138671 bus /gobi_4: Setting Powered False 12:19:00.254659 bus /gobi_1: Setting Powered False 12:19:01.353506 bus /gobi_1: Setting Powered False 12:19:02.473057 bus /gobi_0: Setting Powered False 12:19:03.571499 bus /gobi_0: Setting Powered False 12:19:04.686424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 12:19:05.788277 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:05.799938 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:19:05.840434 tst ping.py: using LAC 28347 12:19:05.965720 tst ping.py: using RAC 42 12:19:06.082803 tst ping.py: using CellId 28347 12:19:06.199997 tst ping.py: using BVCI 28348 12:19:06.305663 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:06.316179 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:06.326627 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:06.337532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:06.348290 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:06.359123 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:06.370012 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:06.380810 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:19:06.498417 tst ping.py:19: start network... 12:19:06.694561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:07.143775 run create_hlr_db(pid=7148): Launched 12:19:07.261870 bus /gobi_6: Setting Powered False 12:19:08.320686 run create_hlr_db(pid=7148): Terminated: ok {rc=0} 12:19:08.728146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7150): Launched 12:19:09.019578 run osmo-hlr_10.42.42.2(pid=7151): Launched 12:19:09.130243 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:09.651220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7153): Launched 12:19:09.942012 run osmo-stp_10.42.42.5(pid=7154): Launched 12:19:10.053096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:19:10.554811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7156): Launched 12:19:10.666040 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:19:10.911593 run patchelf(pid=7157): Launched 12:19:11.073266 run osmo-stp_10.42.42.5(pid=7154): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7154)] 12:19:11.196394 run osmo-stp_10.42.42.5(pid=7154): stdout: | (launched: 2022-12-10_12:19:09.888062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:11.320940 run osmo-stp_10.42.42.5(pid=7154): stderr: | 20221210121910055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121910055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121910056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121910056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121910058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121910058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121910058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:11.445562 run osmo-stp_10.42.42.5(pid=7154): stdout: | (launched: 2022-12-10_12:19:09.888062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:11.564350 run osmo-stp_10.42.42.5(pid=7154): stderr: | 20221210121910055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121910055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121910056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121910056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121910058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121910058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121910058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:11.705395 run patchelf(pid=7157): Terminating (SIGINT) 12:19:11.868157 run patchelf(pid=7157): Terminated: ok {rc=0} 12:19:11.989663 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7154): Process ended prematurely: osmo-stp_10.42.42.5(pid=7154) [trial-2374↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7154)] [trial-2374↪gprs:nanobts+band-1900↪ping.py:22] 12:19:11.998291 tst ping.py:22: Test FAILED (6.2 sec) 12:19:12.024624 run osmo-hlr_10.42.42.2(pid=7151): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7151)] 12:19:12.071619 run osmo-hlr_10.42.42.2(pid=7151): stdout: | (launched: 2022-12-10_12:19:08.966139) 12:19:12.120174 run osmo-hlr_10.42.42.2(pid=7151): stderr: | 20221210121909140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121909140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121909140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121909140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121909140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121909140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121909153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121909161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121909161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121909161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:12.169046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7150): Terminating (SIGTERM) 12:19:12.207886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7153): Terminating (SIGTERM) 12:19:12.246771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7156): Terminating (SIGTERM) 12:19:12.285736 --- ParallelTerminationStrategy: PID 7150 died... 12:19:12.304229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7150): Terminated: ok {rc=0} 12:19:12.347885 --- ParallelTerminationStrategy: PID 7153 died... 12:19:12.366216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7153): Terminated: ok {rc=0} 12:19:12.409261 --- ParallelTerminationStrategy: PID 7156 died... 12:19:12.427492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7156): Terminated: ok {rc=0} 12:19:12.509477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 12:19:13.594948 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:13.606070 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:19:13.644459 tst ping_idle_ping.py: using LAC 28348 12:19:13.759348 tst ping_idle_ping.py: using RAC 43 12:19:13.873574 tst ping_idle_ping.py: using CellId 28348 12:19:13.998074 tst ping_idle_ping.py: using BVCI 28349 12:19:14.111560 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:14.122567 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:14.133564 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:14.145391 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:14.157124 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:14.169356 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:14.180697 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:19:14.192234 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:19:14.305807 tst ping_idle_ping.py:24: start network... 12:19:14.501691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:14.957703 run create_hlr_db(pid=7158): Launched 12:19:15.079695 bus /gobi_6: Setting Powered False 12:19:16.140809 run create_hlr_db(pid=7158): Terminated: ok {rc=0} 12:19:16.595052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7160): Launched 12:19:16.934438 run osmo-hlr_10.42.42.2(pid=7161): Launched 12:19:17.078272 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:17.677498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7163): Launched 12:19:17.970117 run osmo-stp_10.42.42.5(pid=7164): Launched 12:19:18.081042 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:19:18.585602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7166): Launched 12:19:18.697161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:19:18.944883 run patchelf(pid=7167): Launched 12:19:19.107379 run osmo-stp_10.42.42.5(pid=7164): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7164)] 12:19:19.231579 run osmo-stp_10.42.42.5(pid=7164): stdout: | (launched: 2022-12-10_12:19:17.916174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:19.356740 run osmo-stp_10.42.42.5(pid=7164): stderr: | 20221210121918084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121918084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121918085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121918085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121918087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121918087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121918087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:19.482234 run osmo-stp_10.42.42.5(pid=7164): stdout: | (launched: 2022-12-10_12:19:17.916174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:19.602586 run osmo-stp_10.42.42.5(pid=7164): stderr: | 20221210121918084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121918084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121918085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121918085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121918087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121918087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121918087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:19.745498 run patchelf(pid=7167): Terminating (SIGINT) 12:19:19.909836 run patchelf(pid=7167): Terminated: ok {rc=0} 12:19:20.027749 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7164): Process ended prematurely: osmo-stp_10.42.42.5(pid=7164) [trial-2374↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7164)] [trial-2374↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 12:19:20.036533 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:19:20.063073 run osmo-hlr_10.42.42.2(pid=7161): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7161)] 12:19:20.109863 run osmo-hlr_10.42.42.2(pid=7161): stdout: | (launched: 2022-12-10_12:19:16.870063) 12:19:20.158340 run osmo-hlr_10.42.42.2(pid=7161): stderr: | 20221210121917205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121917205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121917205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121917206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121917206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121917206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121917228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121917236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121917236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121917236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:20.206973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7160): Terminating (SIGTERM) 12:19:20.246147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7163): Terminating (SIGTERM) 12:19:20.285187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7166): Terminating (SIGTERM) 12:19:20.324547 --- ParallelTerminationStrategy: PID 7160 died... 12:19:20.343440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7160): Terminated: ok {rc=0} 12:19:20.386807 --- ParallelTerminationStrategy: PID 7163 died... 12:19:20.405204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7163): Terminated: ok {rc=0} 12:19:20.448449 --- ParallelTerminationStrategy: PID 7166 died... 12:19:20.466826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7166): Terminated: ok {rc=0} 12:19:20.550948 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 12:19:21.845608 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:21.851929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:19:21.875430 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:19:21.913062 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:19:21.997603 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:19:22.020531 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:19:22.057639 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:19:22.652020 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:19:22.699413 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:22.710150 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:19:22.749657 tst cs_paging_gprs_active.py: using LAC 28349 12:19:22.870949 tst cs_paging_gprs_active.py: using RAC 44 12:19:22.987780 tst cs_paging_gprs_active.py: using CellId 28349 12:19:23.103325 tst cs_paging_gprs_active.py: using BVCI 28350 12:19:23.210935 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.221754 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.232218 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.242750 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.253252 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.263750 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.274437 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.284822 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:23.295365 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:19:23.407434 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:19:23.522796 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:19:23.721069 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:19:24.017284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Launched 12:19:24.274165 run iperf3-srv_10.42.42.10(pid=7173): Launched 12:19:24.385132 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:19:24.583345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:19:24.880942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7174): Launched 12:19:25.140215 run iperf3-srv_10.42.42.10(pid=7175): Launched 12:19:25.251573 tst cs_paging_gprs_active.py:38: start network... 12:19:25.450061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:25.909131 run create_hlr_db(pid=7176): Launched 12:19:26.030748 bus /gobi_6: Setting Powered False 12:19:27.090129 run create_hlr_db(pid=7176): Terminated: ok {rc=0} 12:19:27.523406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7178): Launched 12:19:27.842841 run osmo-hlr_10.42.42.2(pid=7179): Launched 12:19:27.965312 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:28.515876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7181): Launched 12:19:28.834709 run osmo-stp_10.42.42.5(pid=7182): Launched 12:19:28.957067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:19:29.506197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7184): Launched 12:19:29.628727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:19:29.897557 run patchelf(pid=7185): Launched 12:19:30.075071 run osmo-stp_10.42.42.5(pid=7182): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7182)] 12:19:30.210103 run osmo-stp_10.42.42.5(pid=7182): stdout: | (launched: 2022-12-10_12:19:28.776875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:30.346875 run osmo-stp_10.42.42.5(pid=7182): stderr: | 20221210121928967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121928968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121928968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121928968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121928969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121928969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121928969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:30.483440 run osmo-stp_10.42.42.5(pid=7182): stdout: | (launched: 2022-12-10_12:19:28.776875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:30.614635 run osmo-stp_10.42.42.5(pid=7182): stderr: | 20221210121928967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121928968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121928968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121928968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121928969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121928969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121928969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:30.769092 run patchelf(pid=7185): Terminating (SIGINT) 12:19:30.951325 run patchelf(pid=7185): Terminated: ok {rc=0} 12:19:31.083519 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7182): Process ended prematurely: osmo-stp_10.42.42.5(pid=7182) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7182)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:19:31.094701 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 12:19:31.126491 run osmo-hlr_10.42.42.2(pid=7179): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7179)] 12:19:31.178518 run osmo-hlr_10.42.42.2(pid=7179): stdout: | (launched: 2022-12-10_12:19:27.785277) 12:19:31.231890 run osmo-hlr_10.42.42.2(pid=7179): stderr: | 20221210121927984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121927984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121927984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121927984 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121927984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121927984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121927997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121928005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121928005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121928005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:31.286004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Terminating (SIGTERM) 12:19:31.330286 run iperf3-srv_10.42.42.10(pid=7173): Terminating (SIGTERM) 12:19:31.376313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7174): Terminating (SIGTERM) 12:19:31.420908 run iperf3-srv_10.42.42.10(pid=7175): Terminating (SIGTERM) 12:19:31.467264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7178): Terminating (SIGTERM) 12:19:31.511491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7181): Terminating (SIGTERM) 12:19:31.556851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7184): Terminating (SIGTERM) 12:19:31.601249 --- ParallelTerminationStrategy: PID 7172 died... 12:19:31.621450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Terminated: ok {rc=0} 12:19:31.670550 --- ParallelTerminationStrategy: PID 7173 died... 12:19:31.690978 run iperf3-srv_10.42.42.10(pid=7173): Terminated {rc=256} 12:19:31.739722 --- ParallelTerminationStrategy: PID 7174 died... 12:19:31.759985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7174): Terminated: ok {rc=0} 12:19:31.808768 --- ParallelTerminationStrategy: PID 7175 died... 12:19:31.829137 run iperf3-srv_10.42.42.10(pid=7175): Terminated {rc=256} 12:19:31.877600 --- ParallelTerminationStrategy: PID 7178 died... 12:19:31.898156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7178): Terminated: ok {rc=0} 12:19:31.947107 --- ParallelTerminationStrategy: PID 7181 died... 12:19:31.967339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7181): Terminated: ok {rc=0} 12:19:32.016220 --- ParallelTerminationStrategy: PID 7184 died... 12:19:32.036577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7184): Terminated: ok {rc=0} 12:19:32.126878 bus /gobi_0: Setting Powered False 12:19:33.226051 bus /gobi_0: Setting Powered False 12:19:34.340407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:19:35.488244 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:35.500286 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:19:35.544566 tst iperf3.py: using LAC 28350 12:19:35.671417 tst iperf3.py: using RAC 45 12:19:35.798600 tst iperf3.py: using CellId 28350 12:19:35.922634 tst iperf3.py: using BVCI 28351 12:19:36.039715 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.051001 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.062050 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.073458 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.084532 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.095747 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.107183 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.118353 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:36.129665 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:19:36.245280 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:19:36.460886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:19:36.781493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7186): Launched 12:19:37.058601 run iperf3-srv_10.42.42.10(pid=7188): Launched 12:19:37.178472 tst iperf3.py:8: start network... 12:19:37.394098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:37.888232 run create_hlr_db(pid=7189): Launched 12:19:38.010234 bus /gobi_6: Setting Powered False 12:19:39.073560 run create_hlr_db(pid=7189): Terminated: ok {rc=0} 12:19:39.500870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7191): Launched 12:19:39.799393 run osmo-hlr_10.42.42.2(pid=7192): Launched 12:19:39.912883 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:40.426570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7194): Launched 12:19:40.724571 run osmo-stp_10.42.42.5(pid=7195): Launched 12:19:40.838287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:19:41.352584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7197): Launched 12:19:41.466229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:19:41.717105 run patchelf(pid=7198): Launched 12:19:41.883181 run osmo-stp_10.42.42.5(pid=7195): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7195)] 12:19:42.008886 run osmo-stp_10.42.42.5(pid=7195): stdout: | (launched: 2022-12-10_12:19:40.669868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:42.136087 run osmo-stp_10.42.42.5(pid=7195): stderr: | 20221210121940841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121940841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121940841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121940842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121940842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121940842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121940842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:42.264019 run osmo-stp_10.42.42.5(pid=7195): stdout: | (launched: 2022-12-10_12:19:40.669868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:42.385232 run osmo-stp_10.42.42.5(pid=7195): stderr: | 20221210121940841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121940841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121940841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121940842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121940842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121940842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121940842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:42.529692 run patchelf(pid=7198): Terminating (SIGINT) 12:19:42.697102 run patchelf(pid=7198): Terminated: ok {rc=0} 12:19:42.816717 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7195): Process ended prematurely: osmo-stp_10.42.42.5(pid=7195) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7195)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 12:19:42.826112 tst iperf3.py:8: Test FAILED (7.4 sec) 12:19:42.852712 run osmo-hlr_10.42.42.2(pid=7192): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7192)] 12:19:42.899522 run osmo-hlr_10.42.42.2(pid=7192): stdout: | (launched: 2022-12-10_12:19:39.744101) 12:19:42.947826 run osmo-hlr_10.42.42.2(pid=7192): stderr: | 20221210121939921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121939921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121939921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121939921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121939921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121939921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121939938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121939949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121939949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121939949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:42.996617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7186): Terminating (SIGTERM) 12:19:43.036333 run iperf3-srv_10.42.42.10(pid=7188): Terminating (SIGTERM) 12:19:43.075565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7191): Terminating (SIGTERM) 12:19:43.114692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7194): Terminating (SIGTERM) 12:19:43.153702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7197): Terminating (SIGTERM) 12:19:43.193197 --- ParallelTerminationStrategy: PID 7186 died... 12:19:43.211990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7186): Terminated: ok {rc=0} 12:19:43.255592 --- ParallelTerminationStrategy: PID 7188 died... 12:19:43.274019 run iperf3-srv_10.42.42.10(pid=7188): Terminated {rc=256} 12:19:43.317577 --- ParallelTerminationStrategy: PID 7191 died... 12:19:43.335970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7191): Terminated: ok {rc=0} 12:19:43.379861 --- ParallelTerminationStrategy: PID 7194 died... 12:19:43.398449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7194): Terminated: ok {rc=0} 12:19:43.442030 --- ParallelTerminationStrategy: PID 7197 died... 12:19:43.460574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7197): Terminated: ok {rc=0} 12:19:43.543386 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:19:44.685975 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:44.697583 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:19:44.738399 tst iperf3m4.py: using LAC 28351 12:19:44.856935 tst iperf3m4.py: using RAC 46 12:19:44.972805 tst iperf3m4.py: using CellId 28351 12:19:45.089988 tst iperf3m4.py: using BVCI 28352 12:19:45.197382 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.208277 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.219089 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.229973 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.240540 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.251144 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.262084 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.272551 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:19:45.283327 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:19:45.400038 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:19:45.517218 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:19:45.636895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:19:45.753483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:19:45.967464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:19:46.277311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7199): Launched 12:19:46.576776 run iperf3-srv_10.42.42.10(pid=7200): Launched 12:19:46.751016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:19:46.978976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:19:47.286442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7201): Launched 12:19:47.546694 run iperf3-srv_10.42.42.10(pid=7202): Launched 12:19:47.658784 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:19:47.857934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:19:48.156547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7203): Launched 12:19:48.415708 run iperf3-srv_10.42.42.10(pid=7204): Launched 12:19:48.527153 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:19:48.726213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:19:49.024518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7205): Launched 12:19:49.284354 run iperf3-srv_10.42.42.10(pid=7206): Launched 12:19:49.395162 tst iperf3m4.py:8: start network... 12:19:49.593485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:50.054536 run create_hlr_db(pid=7207): Launched 12:19:50.176865 bus /gobi_6: Setting Powered False 12:19:51.237734 run create_hlr_db(pid=7207): Terminated: ok {rc=0} 12:19:51.654556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7209): Launched 12:19:51.951889 run osmo-hlr_10.42.42.2(pid=7210): Launched 12:19:52.064702 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:52.589449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7212): Launched 12:19:52.886856 run osmo-stp_10.42.42.5(pid=7213): Launched 12:19:52.999457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:19:53.510802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7215): Launched 12:19:53.624177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:19:53.875375 run patchelf(pid=7216): Launched 12:19:54.041445 run osmo-stp_10.42.42.5(pid=7213): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7213)] 12:19:54.167035 run osmo-stp_10.42.42.5(pid=7213): stdout: | (launched: 2022-12-10_12:19:52.832241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:54.294675 run osmo-stp_10.42.42.5(pid=7213): stderr: | 20221210121953001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121953001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121953001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121953002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121953004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121953004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121953004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:54.422380 run osmo-stp_10.42.42.5(pid=7213): stdout: | (launched: 2022-12-10_12:19:52.832241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:54.543781 run osmo-stp_10.42.42.5(pid=7213): stderr: | 20221210121953001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210121953001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210121953001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210121953002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210121953004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210121953004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210121953004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:54.687704 run patchelf(pid=7216): Terminating (SIGINT) 12:19:54.855205 run patchelf(pid=7216): Terminated: ok {rc=0} 12:19:54.975682 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7213): Process ended prematurely: osmo-stp_10.42.42.5(pid=7213) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7213)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 12:19:54.985319 tst iperf3m4.py:8: Test FAILED (10.3 sec) 12:19:55.012373 run osmo-hlr_10.42.42.2(pid=7210): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7210)] 12:19:55.059057 run osmo-hlr_10.42.42.2(pid=7210): stdout: | (launched: 2022-12-10_12:19:51.897290) 12:19:55.107462 run osmo-hlr_10.42.42.2(pid=7210): stderr: | 20221210121952076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210121952076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210121952076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210121952076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210121952076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210121952076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210121952089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210121952097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210121952098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210121952098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:55.157125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7199): Terminating (SIGTERM) 12:19:55.196328 run iperf3-srv_10.42.42.10(pid=7200): Terminating (SIGTERM) 12:19:55.235259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7201): Terminating (SIGTERM) 12:19:55.274231 run iperf3-srv_10.42.42.10(pid=7202): Terminating (SIGTERM) 12:19:55.313176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7203): Terminating (SIGTERM) 12:19:55.352232 run iperf3-srv_10.42.42.10(pid=7204): Terminating (SIGTERM) 12:19:55.391146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7205): Terminating (SIGTERM) 12:19:55.430345 run iperf3-srv_10.42.42.10(pid=7206): Terminating (SIGTERM) 12:19:55.469294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7209): Terminating (SIGTERM) 12:19:55.508410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7212): Terminating (SIGTERM) 12:19:55.547536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7215): Terminating (SIGTERM) 12:19:55.587311 --- ParallelTerminationStrategy: PID 7199 died... 12:19:55.606320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7199): Terminated: ok {rc=0} 12:19:55.649942 --- ParallelTerminationStrategy: PID 7200 died... 12:19:55.668327 run iperf3-srv_10.42.42.10(pid=7200): Terminated {rc=256} 12:19:55.711676 --- ParallelTerminationStrategy: PID 7201 died... 12:19:55.730258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7201): Terminated: ok {rc=0} 12:19:55.774233 --- ParallelTerminationStrategy: PID 7202 died... 12:19:55.792677 run iperf3-srv_10.42.42.10(pid=7202): Terminated {rc=256} 12:19:55.836324 --- ParallelTerminationStrategy: PID 7203 died... 12:19:55.854850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7203): Terminated: ok {rc=0} 12:19:55.898022 --- ParallelTerminationStrategy: PID 7204 died... 12:19:55.916426 run iperf3-srv_10.42.42.10(pid=7204): Terminated {rc=256} 12:19:55.959662 --- ParallelTerminationStrategy: PID 7205 died... 12:19:55.978220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7205): Terminated: ok {rc=0} 12:19:56.021627 --- ParallelTerminationStrategy: PID 7206 died... 12:19:56.040026 run iperf3-srv_10.42.42.10(pid=7206): Terminated {rc=256} 12:19:56.083200 --- ParallelTerminationStrategy: PID 7209 died... 12:19:56.101721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7209): Terminated: ok {rc=0} 12:19:56.145222 --- ParallelTerminationStrategy: PID 7212 died... 12:19:56.163518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7212): Terminated: ok {rc=0} 12:19:56.207233 --- ParallelTerminationStrategy: PID 7215 died... 12:19:56.225939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7215): Terminated: ok {rc=0} 12:19:56.311602 bus /gobi_4: Setting Powered False 12:19:57.411646 bus /gobi_4: Setting Powered False 12:19:58.523930 bus /gobi_1: Setting Powered False 12:19:59.621410 bus /gobi_1: Setting Powered False 12:20:00.739233 bus /gobi_0: Setting Powered False 12:20:01.836419 bus /gobi_0: Setting Powered False 12:20:02.950982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 12:20:04.049975 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.061391 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:20:04.104782 tst ping.py: using LAC 28352 12:20:04.220704 tst ping.py: using RAC 47 12:20:04.342543 tst ping.py: using CellId 28352 12:20:04.462937 tst ping.py: using BVCI 28353 12:20:04.578553 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.590352 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.601896 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.614004 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.625924 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.637148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.648724 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:04.660222 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:20:04.778371 tst ping.py:19: start network... 12:20:04.989228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:05.475345 run create_hlr_db(pid=7220): Launched 12:20:05.595516 bus /gobi_6: Setting Powered False 12:20:06.654122 run create_hlr_db(pid=7220): Terminated: ok {rc=0} 12:20:07.092124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7222): Launched 12:20:07.405504 run osmo-hlr_10.42.42.2(pid=7223): Launched 12:20:07.527572 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:08.072582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7225): Launched 12:20:08.386877 run osmo-stp_10.42.42.5(pid=7226): Launched 12:20:08.507777 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:20:09.049920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7228): Launched 12:20:09.169948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:20:09.435834 run patchelf(pid=7229): Launched 12:20:09.611323 run osmo-stp_10.42.42.5(pid=7226): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7226)] 12:20:09.744183 run osmo-stp_10.42.42.5(pid=7226): stdout: | (launched: 2022-12-10_12:20:08.329615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:09.878866 run osmo-stp_10.42.42.5(pid=7226): stderr: | 20221210122008519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122008519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122008519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122008519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122008522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122008522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122008522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:10.013805 run osmo-stp_10.42.42.5(pid=7226): stdout: | (launched: 2022-12-10_12:20:08.329615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:10.142658 run osmo-stp_10.42.42.5(pid=7226): stderr: | 20221210122008519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122008519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122008519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122008519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122008522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122008522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122008522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:10.295461 run patchelf(pid=7229): Terminating (SIGINT) 12:20:10.471116 run patchelf(pid=7229): Terminated: ok {rc=0} 12:20:10.597824 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7226): Process ended prematurely: osmo-stp_10.42.42.5(pid=7226) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7226)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 12:20:10.607583 tst ping.py:22: Test FAILED (6.5 sec) 12:20:10.635719 run osmo-hlr_10.42.42.2(pid=7223): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7223)] 12:20:10.685566 run osmo-hlr_10.42.42.2(pid=7223): stdout: | (launched: 2022-12-10_12:20:07.348705) 12:20:10.737072 run osmo-hlr_10.42.42.2(pid=7223): stderr: | 20221210122007544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122007544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122007544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122007544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122007544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122007544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122007555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122007564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122007564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122007564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:10.789043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7222): Terminating (SIGTERM) 12:20:10.830775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7225): Terminating (SIGTERM) 12:20:10.872366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7228): Terminating (SIGTERM) 12:20:10.914422 --- ParallelTerminationStrategy: PID 7222 died... 12:20:10.934213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7222): Terminated: ok {rc=0} 12:20:10.980896 --- ParallelTerminationStrategy: PID 7225 died... 12:20:11.000319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7225): Terminated: ok {rc=0} 12:20:11.046656 --- ParallelTerminationStrategy: PID 7228 died... 12:20:11.066015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7228): Terminated: ok {rc=0} 12:20:11.153826 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:20:12.240825 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.253251 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:20:12.295913 tst ping_idle_ping.py: using LAC 28353 12:20:12.420562 tst ping_idle_ping.py: using RAC 48 12:20:12.542138 tst ping_idle_ping.py: using CellId 28353 12:20:12.665255 tst ping_idle_ping.py: using BVCI 28354 12:20:12.771691 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.782742 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.793707 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.804648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.815572 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.826671 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.837676 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:20:12.848299 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:20:12.963599 tst ping_idle_ping.py:24: start network... 12:20:13.175107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:13.669704 run create_hlr_db(pid=7230): Launched 12:20:13.790170 bus /gobi_6: Setting Powered False 12:20:14.852392 run create_hlr_db(pid=7230): Terminated: ok {rc=0} 12:20:15.292169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7232): Launched 12:20:15.607790 run osmo-hlr_10.42.42.2(pid=7233): Launched 12:20:15.729478 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:16.303192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7235): Launched 12:20:16.635575 run osmo-stp_10.42.42.5(pid=7236): Launched 12:20:16.885991 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:20:17.520242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7238): Launched 12:20:17.642187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:20:17.908209 run patchelf(pid=7239): Launched 12:20:18.083246 run osmo-stp_10.42.42.5(pid=7236): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7236)] 12:20:18.216471 run osmo-stp_10.42.42.5(pid=7236): stdout: | (launched: 2022-12-10_12:20:16.574830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:18.351573 run osmo-stp_10.42.42.5(pid=7236): stderr: | 20221210122016788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122016788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122016788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122016788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122016789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122016789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122016789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:18.486494 run osmo-stp_10.42.42.5(pid=7236): stdout: | (launched: 2022-12-10_12:20:16.574830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:18.616434 run osmo-stp_10.42.42.5(pid=7236): stderr: | 20221210122016788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122016788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122016788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122016788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122016789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122016789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122016789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:18.769771 run patchelf(pid=7239): Terminating (SIGINT) 12:20:18.946579 run patchelf(pid=7239): Terminated: ok {rc=0} 12:20:19.073642 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7236): Process ended prematurely: osmo-stp_10.42.42.5(pid=7236) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7236)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:20:19.082965 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:20:19.110897 run osmo-hlr_10.42.42.2(pid=7233): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7233)] 12:20:19.161276 run osmo-hlr_10.42.42.2(pid=7233): stdout: | (launched: 2022-12-10_12:20:15.550245) 12:20:19.212451 run osmo-hlr_10.42.42.2(pid=7233): stderr: | 20221210122015748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122015748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122015748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122015748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122015748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122015748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122015760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122015768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122015769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122015769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:19.264078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7232): Terminating (SIGTERM) 12:20:19.305906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7235): Terminating (SIGTERM) 12:20:19.348094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7238): Terminating (SIGTERM) 12:20:19.390131 --- ParallelTerminationStrategy: PID 7232 died... 12:20:19.409946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7232): Terminated: ok {rc=0} 12:20:19.456556 --- ParallelTerminationStrategy: PID 7235 died... 12:20:19.476062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7235): Terminated: ok {rc=0} 12:20:19.522450 --- ParallelTerminationStrategy: PID 7238 died... 12:20:19.541904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7238): Terminated: ok {rc=0} 12:20:19.630043 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:20:20.919363 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:20.926114 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:20:20.950461 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:20:20.988768 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:20:21.073196 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:20:21.096124 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:20:21.134366 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:20:21.728267 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:20:21.776763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:21.787524 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:20:21.847831 tst cs_paging_gprs_active.py: using LAC 28354 12:20:21.974500 tst cs_paging_gprs_active.py: using RAC 49 12:20:22.097582 tst cs_paging_gprs_active.py: using CellId 28354 12:20:22.215621 tst cs_paging_gprs_active.py: using BVCI 28355 12:20:22.323613 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.334430 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.345033 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.356578 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.367828 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.378965 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.390182 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.401222 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:22.412406 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:20:22.530285 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:20:22.645723 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:20:22.846875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:20:23.145454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7243): Launched 12:20:23.404792 run iperf3-srv_10.42.42.10(pid=7244): Launched 12:20:23.516778 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:20:23.716043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:20:24.013921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7245): Launched 12:20:24.272728 run iperf3-srv_10.42.42.10(pid=7246): Launched 12:20:24.384605 tst cs_paging_gprs_active.py:38: start network... 12:20:24.584199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:25.045176 run create_hlr_db(pid=7247): Launched 12:20:25.167651 bus /gobi_6: Setting Powered False 12:20:26.227092 run create_hlr_db(pid=7247): Terminated: ok {rc=0} 12:20:26.663997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7249): Launched 12:20:26.984598 run osmo-hlr_10.42.42.2(pid=7250): Launched 12:20:27.107606 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:27.659576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7252): Launched 12:20:27.979686 run osmo-stp_10.42.42.5(pid=7253): Launched 12:20:28.102275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:20:28.652564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7255): Launched 12:20:28.775411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:20:29.044172 run patchelf(pid=7256): Launched 12:20:29.221785 run osmo-stp_10.42.42.5(pid=7253): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7253)] 12:20:29.357568 run osmo-stp_10.42.42.5(pid=7253): stdout: | (launched: 2022-12-10_12:20:27.921690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:29.495215 run osmo-stp_10.42.42.5(pid=7253): stderr: | 20221210122028114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122028114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122028114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122028114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122028115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122028115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122028115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:29.632841 run osmo-stp_10.42.42.5(pid=7253): stdout: | (launched: 2022-12-10_12:20:27.921690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:29.763664 run osmo-stp_10.42.42.5(pid=7253): stderr: | 20221210122028114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122028114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122028114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122028114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122028115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122028115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122028115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:29.919184 run patchelf(pid=7256): Terminating (SIGINT) 12:20:30.098076 run patchelf(pid=7256): Terminated: ok {rc=0} 12:20:30.227038 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7253): Process ended prematurely: osmo-stp_10.42.42.5(pid=7253) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7253)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:20:30.237063 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 12:20:30.265989 run osmo-hlr_10.42.42.2(pid=7250): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7250)] 12:20:30.315911 run osmo-hlr_10.42.42.2(pid=7250): stdout: | (launched: 2022-12-10_12:20:26.926587) 12:20:30.367554 run osmo-hlr_10.42.42.2(pid=7250): stderr: | 20221210122027123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122027123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122027123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122027123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122027123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122027123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122027135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122027143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122027143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122027143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:30.419625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7243): Terminating (SIGTERM) 12:20:30.461354 run iperf3-srv_10.42.42.10(pid=7244): Terminating (SIGTERM) 12:20:30.502996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7245): Terminating (SIGTERM) 12:20:30.544849 run iperf3-srv_10.42.42.10(pid=7246): Terminating (SIGTERM) 12:20:30.587258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7249): Terminating (SIGTERM) 12:20:30.629125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7252): Terminating (SIGTERM) 12:20:30.670805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7255): Terminating (SIGTERM) 12:20:30.712928 --- ParallelTerminationStrategy: PID 7243 died... 12:20:30.732842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7243): Terminated: ok {rc=0} 12:20:30.779194 --- ParallelTerminationStrategy: PID 7244 died... 12:20:30.798569 run iperf3-srv_10.42.42.10(pid=7244): Terminated {rc=256} 12:20:30.847381 --- ParallelTerminationStrategy: PID 7245 died... 12:20:30.867222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7245): Terminated: ok {rc=0} 12:20:30.923033 --- ParallelTerminationStrategy: PID 7246 died... 12:20:30.942660 run iperf3-srv_10.42.42.10(pid=7246): Terminated {rc=256} 12:20:30.989714 --- ParallelTerminationStrategy: PID 7249 died... 12:20:31.009749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7249): Terminated: ok {rc=0} 12:20:31.056753 --- ParallelTerminationStrategy: PID 7252 died... 12:20:31.077047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7252): Terminated: ok {rc=0} 12:20:31.124325 --- ParallelTerminationStrategy: PID 7255 died... 12:20:31.144244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7255): Terminated: ok {rc=0} 12:20:31.233282 bus /gobi_0: Setting Powered False 12:20:32.330650 bus /gobi_0: Setting Powered False 12:20:33.446146 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:20:34.591493 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:34.603017 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:20:34.664728 tst iperf3.py: using LAC 28355 12:20:34.780576 tst iperf3.py: using RAC 50 12:20:34.896786 tst iperf3.py: using CellId 28355 12:20:35.012781 tst iperf3.py: using BVCI 28356 12:20:35.119301 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.130308 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.141274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.151989 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.162718 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.173550 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.184324 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.195032 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:35.205915 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:20:35.322540 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:20:35.540242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:20:35.861045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7257): Launched 12:20:36.137767 run iperf3-srv_10.42.42.10(pid=7258): Launched 12:20:36.257743 tst iperf3.py:8: start network... 12:20:36.473464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:36.967599 run create_hlr_db(pid=7259): Launched 12:20:37.090325 bus /gobi_6: Setting Powered False 12:20:38.153546 run create_hlr_db(pid=7259): Terminated: ok {rc=0} 12:20:38.580036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7261): Launched 12:20:38.877680 run osmo-hlr_10.42.42.2(pid=7262): Launched 12:20:38.990383 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:39.505774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7264): Launched 12:20:39.803684 run osmo-stp_10.42.42.5(pid=7265): Launched 12:20:39.917958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:20:40.431397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7267): Launched 12:20:40.544558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:20:40.795663 run patchelf(pid=7268): Launched 12:20:40.961583 run osmo-stp_10.42.42.5(pid=7265): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7265)] 12:20:41.086949 run osmo-stp_10.42.42.5(pid=7265): stdout: | (launched: 2022-12-10_12:20:39.749064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:41.214258 run osmo-stp_10.42.42.5(pid=7265): stderr: | 20221210122039918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122039918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122039918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122039919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122039919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122039919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122039919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:41.341350 run osmo-stp_10.42.42.5(pid=7265): stdout: | (launched: 2022-12-10_12:20:39.749064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:41.462842 run osmo-stp_10.42.42.5(pid=7265): stderr: | 20221210122039918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122039918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122039918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122039919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122039919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122039919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122039919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:41.607374 run patchelf(pid=7268): Terminating (SIGINT) 12:20:41.775385 run patchelf(pid=7268): Terminated: ok {rc=0} 12:20:41.895742 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7265): Process ended prematurely: osmo-stp_10.42.42.5(pid=7265) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7265)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:20:41.905112 tst iperf3.py:8: Test FAILED (7.3 sec) 12:20:41.931871 run osmo-hlr_10.42.42.2(pid=7262): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7262)] 12:20:41.978730 run osmo-hlr_10.42.42.2(pid=7262): stdout: | (launched: 2022-12-10_12:20:38.823649) 12:20:42.027215 run osmo-hlr_10.42.42.2(pid=7262): stderr: | 20221210122039000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122039000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122039000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122039000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122039001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122039001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122039012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122039023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122039023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122039023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:42.076355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7257): Terminating (SIGTERM) 12:20:42.115546 run iperf3-srv_10.42.42.10(pid=7258): Terminating (SIGTERM) 12:20:42.154624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7261): Terminating (SIGTERM) 12:20:42.193692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7264): Terminating (SIGTERM) 12:20:42.232631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7267): Terminating (SIGTERM) 12:20:42.271941 --- ParallelTerminationStrategy: PID 7257 died... 12:20:42.290833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7257): Terminated: ok {rc=0} 12:20:42.334409 --- ParallelTerminationStrategy: PID 7258 died... 12:20:42.352822 run iperf3-srv_10.42.42.10(pid=7258): Terminated {rc=256} 12:20:42.395872 --- ParallelTerminationStrategy: PID 7261 died... 12:20:42.414594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7261): Terminated: ok {rc=0} 12:20:42.457736 --- ParallelTerminationStrategy: PID 7264 died... 12:20:42.476112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7264): Terminated: ok {rc=0} 12:20:42.519175 --- ParallelTerminationStrategy: PID 7267 died... 12:20:42.537779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7267): Terminated: ok {rc=0} 12:20:42.622372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:20:43.770493 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:43.782031 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:20:43.842561 tst iperf3m4.py: using LAC 28356 12:20:43.959366 tst iperf3m4.py: using RAC 51 12:20:44.079479 tst iperf3m4.py: using CellId 28356 12:20:44.196396 tst iperf3m4.py: using BVCI 28357 12:20:44.303570 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.314435 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.325077 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.335655 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.346179 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.356687 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.367355 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.377896 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:20:44.388529 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:20:44.505661 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:20:44.627396 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:20:44.741226 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:20:44.857636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:20:45.057972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:20:45.356197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7269): Launched 12:20:45.616782 run iperf3-srv_10.42.42.10(pid=7270): Launched 12:20:45.728298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:20:45.935814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:20:46.252058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7271): Launched 12:20:46.540387 run iperf3-srv_10.42.42.10(pid=7272): Launched 12:20:46.660644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:20:46.864342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:20:47.178851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7273): Launched 12:20:47.442997 run iperf3-srv_10.42.42.10(pid=7274): Launched 12:20:47.555342 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:20:47.754422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:20:48.053538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7275): Launched 12:20:48.312051 run iperf3-srv_10.42.42.10(pid=7276): Launched 12:20:48.423157 tst iperf3m4.py:8: start network... 12:20:48.621500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:49.079795 run create_hlr_db(pid=7277): Launched 12:20:49.204335 bus /gobi_6: Setting Powered False 12:20:50.264323 run create_hlr_db(pid=7277): Terminated: ok {rc=0} 12:20:50.679364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7279): Launched 12:20:50.977386 run osmo-hlr_10.42.42.2(pid=7280): Launched 12:20:51.090338 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:51.603148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7282): Launched 12:20:51.901275 run osmo-stp_10.42.42.5(pid=7283): Launched 12:20:52.014902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:20:52.526161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7285): Launched 12:20:52.639317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:20:52.889834 run patchelf(pid=7286): Launched 12:20:53.054861 run osmo-stp_10.42.42.5(pid=7283): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7283)] 12:20:53.180512 run osmo-stp_10.42.42.5(pid=7283): stdout: | (launched: 2022-12-10_12:20:51.846272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:53.308086 run osmo-stp_10.42.42.5(pid=7283): stderr: | 20221210122052016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122052018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122052018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122052019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122052019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122052019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122052019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:53.435998 run osmo-stp_10.42.42.5(pid=7283): stdout: | (launched: 2022-12-10_12:20:51.846272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:53.557592 run osmo-stp_10.42.42.5(pid=7283): stderr: | 20221210122052016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122052018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122052018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122052019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122052019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122052019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122052019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:53.703093 run patchelf(pid=7286): Terminating (SIGINT) 12:20:53.870906 run patchelf(pid=7286): Terminated: ok {rc=0} 12:20:53.991275 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7283): Process ended prematurely: osmo-stp_10.42.42.5(pid=7283) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7283)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:20:54.000764 tst iperf3m4.py:8: Test FAILED (10.3 sec) 12:20:54.027863 run osmo-hlr_10.42.42.2(pid=7280): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7280)] 12:20:54.074751 run osmo-hlr_10.42.42.2(pid=7280): stdout: | (launched: 2022-12-10_12:20:50.922632) 12:20:54.123539 run osmo-hlr_10.42.42.2(pid=7280): stderr: | 20221210122051100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122051100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122051100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122051100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122051100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122051100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122051112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122051121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122051121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122051121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:54.172645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7269): Terminating (SIGTERM) 12:20:54.212032 run iperf3-srv_10.42.42.10(pid=7270): Terminating (SIGTERM) 12:20:54.251324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7271): Terminating (SIGTERM) 12:20:54.290604 run iperf3-srv_10.42.42.10(pid=7272): Terminating (SIGTERM) 12:20:54.329664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7273): Terminating (SIGTERM) 12:20:54.368761 run iperf3-srv_10.42.42.10(pid=7274): Terminating (SIGTERM) 12:20:54.407918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7275): Terminating (SIGTERM) 12:20:54.447069 run iperf3-srv_10.42.42.10(pid=7276): Terminating (SIGTERM) 12:20:54.486040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7279): Terminating (SIGTERM) 12:20:54.525114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7282): Terminating (SIGTERM) 12:20:54.564146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7285): Terminating (SIGTERM) 12:20:54.603516 --- ParallelTerminationStrategy: PID 7269 died... 12:20:54.622524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7269): Terminated: ok {rc=0} 12:20:54.666081 --- ParallelTerminationStrategy: PID 7270 died... 12:20:54.684356 run iperf3-srv_10.42.42.10(pid=7270): Terminated {rc=256} 12:20:54.727760 --- ParallelTerminationStrategy: PID 7271 died... 12:20:54.746148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7271): Terminated: ok {rc=0} 12:20:54.789439 --- ParallelTerminationStrategy: PID 7272 died... 12:20:54.807728 run iperf3-srv_10.42.42.10(pid=7272): Terminated {rc=256} 12:20:54.851441 --- ParallelTerminationStrategy: PID 7273 died... 12:20:54.869823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7273): Terminated: ok {rc=0} 12:20:54.913286 --- ParallelTerminationStrategy: PID 7274 died... 12:20:54.931570 run iperf3-srv_10.42.42.10(pid=7274): Terminated {rc=256} 12:20:54.975170 --- ParallelTerminationStrategy: PID 7275 died... 12:20:54.993778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7275): Terminated: ok {rc=0} 12:20:55.037287 --- ParallelTerminationStrategy: PID 7276 died... 12:20:55.055547 run iperf3-srv_10.42.42.10(pid=7276): Terminated {rc=256} 12:20:55.099728 --- ParallelTerminationStrategy: PID 7279 died... 12:20:55.118265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7279): Terminated: ok {rc=0} 12:20:55.162244 --- ParallelTerminationStrategy: PID 7282 died... 12:20:55.180914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7282): Terminated: ok {rc=0} 12:20:55.224571 --- ParallelTerminationStrategy: PID 7285 died... 12:20:55.243167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7285): Terminated: ok {rc=0} 12:20:55.325855 bus /gobi_4: Setting Powered False 12:20:56.421734 bus /gobi_4: Setting Powered False 12:20:57.536904 bus /gobi_1: Setting Powered False 12:20:58.635415 bus /gobi_1: Setting Powered False 12:20:59.746537 bus /gobi_0: Setting Powered False 12:21:00.845461 bus /gobi_0: Setting Powered False 12:21:01.979876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:21:03.085655 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.097788 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:21:03.158602 tst ping.py: using LAC 28357 12:21:03.281149 tst ping.py: using RAC 52 12:21:03.397788 tst ping.py: using CellId 28357 12:21:03.513671 tst ping.py: using BVCI 28358 12:21:03.619837 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.630835 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.641488 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.652090 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.663031 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.673809 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.684569 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:03.695165 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:21:03.810769 tst ping.py:19: start network... 12:21:04.022657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:04.508753 run create_hlr_db(pid=7287): Launched 12:21:04.629882 bus /gobi_6: Setting Powered False 12:21:05.693031 run create_hlr_db(pid=7287): Terminated: ok {rc=0} 12:21:06.113936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7289): Launched 12:21:06.405586 run osmo-hlr_10.42.42.2(pid=7290): Launched 12:21:06.517023 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:07.041922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7292): Launched 12:21:07.332635 run osmo-stp_10.42.42.5(pid=7293): Launched 12:21:07.443639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:21:07.947092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7295): Launched 12:21:08.058061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:21:08.302648 run patchelf(pid=7296): Launched 12:21:08.464021 run osmo-stp_10.42.42.5(pid=7293): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7293)] 12:21:08.587319 run osmo-stp_10.42.42.5(pid=7293): stdout: | (launched: 2022-12-10_12:21:07.279080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:08.711924 run osmo-stp_10.42.42.5(pid=7293): stderr: | 20221210122107448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122107448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122107448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122107449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122107451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122107451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122107451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:08.836173 run osmo-stp_10.42.42.5(pid=7293): stdout: | (launched: 2022-12-10_12:21:07.279080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:08.955099 run osmo-stp_10.42.42.5(pid=7293): stderr: | 20221210122107448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122107448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122107448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122107449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122107451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122107451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122107451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:09.096333 run patchelf(pid=7296): Terminating (SIGINT) 12:21:09.259447 run patchelf(pid=7296): Terminated: ok {rc=0} 12:21:09.376802 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7293): Process ended prematurely: osmo-stp_10.42.42.5(pid=7293) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7293)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 12:21:09.385551 tst ping.py:22: Test FAILED (6.3 sec) 12:21:09.411825 run osmo-hlr_10.42.42.2(pid=7290): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7290)] 12:21:09.458398 run osmo-hlr_10.42.42.2(pid=7290): stdout: | (launched: 2022-12-10_12:21:06.351924) 12:21:09.506627 run osmo-hlr_10.42.42.2(pid=7290): stderr: | 20221210122106525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122106525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122106525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122106526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122106526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122106526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122106538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122106546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122106546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122106547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:09.555027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7289): Terminating (SIGTERM) 12:21:09.593701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7292): Terminating (SIGTERM) 12:21:09.632282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7295): Terminating (SIGTERM) 12:21:09.671270 --- ParallelTerminationStrategy: PID 7289 died... 12:21:09.689863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7289): Terminated: ok {rc=0} 12:21:09.733852 --- ParallelTerminationStrategy: PID 7292 died... 12:21:09.752230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7292): Terminated: ok {rc=0} 12:21:09.795078 --- ParallelTerminationStrategy: PID 7295 died... 12:21:09.813340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7295): Terminated: ok {rc=0} 12:21:09.897155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:21:10.985118 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:10.996918 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:21:11.057197 tst ping_idle_ping.py: using LAC 28358 12:21:11.173409 tst ping_idle_ping.py: using RAC 53 12:21:11.287618 tst ping_idle_ping.py: using CellId 28358 12:21:11.403280 tst ping_idle_ping.py: using BVCI 28359 12:21:11.509717 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:11.520492 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:11.531159 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:11.541812 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:11.552318 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:11.562916 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:11.573583 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:21:11.584181 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:21:11.701634 tst ping_idle_ping.py:24: start network... 12:21:11.915087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:12.404011 run create_hlr_db(pid=7297): Launched 12:21:12.524802 bus /gobi_6: Setting Powered False 12:21:13.587860 run create_hlr_db(pid=7297): Terminated: ok {rc=0} 12:21:14.010049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7299): Launched 12:21:14.303850 run osmo-hlr_10.42.42.2(pid=7300): Launched 12:21:14.416019 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:14.919861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7302): Launched 12:21:15.212179 run osmo-stp_10.42.42.5(pid=7303): Launched 12:21:15.324197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:21:15.832047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7305): Launched 12:21:15.970701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:21:16.236594 run patchelf(pid=7306): Launched 12:21:16.408175 run osmo-stp_10.42.42.5(pid=7303): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7303)] 12:21:16.534930 run osmo-stp_10.42.42.5(pid=7303): stdout: | (launched: 2022-12-10_12:21:15.157918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:16.663686 run osmo-stp_10.42.42.5(pid=7303): stderr: | 20221210122115326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122115326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122115326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122115326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122115327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122115327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122115327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:16.791651 run osmo-stp_10.42.42.5(pid=7303): stdout: | (launched: 2022-12-10_12:21:15.157918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:16.914355 run osmo-stp_10.42.42.5(pid=7303): stderr: | 20221210122115326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122115326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122115326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122115326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122115327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122115327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122115327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:17.060043 run patchelf(pid=7306): Terminating (SIGINT) 12:21:17.227604 run patchelf(pid=7306): Terminated: ok {rc=0} 12:21:17.346281 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7303): Process ended prematurely: osmo-stp_10.42.42.5(pid=7303) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7303)] [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:21:17.355151 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:21:17.381814 run osmo-hlr_10.42.42.2(pid=7300): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7300)] 12:21:17.429363 run osmo-hlr_10.42.42.2(pid=7300): stdout: | (launched: 2022-12-10_12:21:14.249976) 12:21:17.478442 run osmo-hlr_10.42.42.2(pid=7300): stderr: | 20221210122114426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122114426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122114426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122114426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122114427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122114427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122114442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122114452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122114452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122114452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:17.529204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7299): Terminating (SIGTERM) 12:21:17.568641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7302): Terminating (SIGTERM) 12:21:17.608031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7305): Terminating (SIGTERM) 12:21:17.647663 --- ParallelTerminationStrategy: PID 7299 died... 12:21:17.666261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7299): Terminated: ok {rc=0} 12:21:17.709754 --- ParallelTerminationStrategy: PID 7302 died... 12:21:17.728041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7302): Terminated: ok {rc=0} 12:21:17.772667 --- ParallelTerminationStrategy: PID 7305 died... 12:21:17.791318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7305): Terminated: ok {rc=0} 12:21:17.876822 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:21:19.168788 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:19.176510 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:21:19.199952 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:21:19.233347 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:21:19.287858 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:21:19.313262 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:21:19.348394 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:21:19.902836 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:21:19.908086 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:19.919551 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:21:19.978993 tst switch_tch_pdch.py: using LAC 28359 12:21:20.093719 tst switch_tch_pdch.py: using RAC 54 12:21:20.210243 tst switch_tch_pdch.py: using CellId 28359 12:21:20.325414 tst switch_tch_pdch.py: using BVCI 28360 12:21:20.430110 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:20.441511 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:20.452651 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:20.463951 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:20.475164 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:20.486302 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:20.497617 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:21:20.508803 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:20.626846 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:20.740213 tst switch_tch_pdch.py:51: start network... 12:21:20.934420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:21.385533 run create_hlr_db(pid=7311): Launched 12:21:21.505116 bus /gobi_6: Setting Powered False 12:21:22.567676 run create_hlr_db(pid=7311): Terminated: ok {rc=0} 12:21:22.987030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7313): Launched 12:21:23.278578 run osmo-hlr_10.42.42.2(pid=7314): Launched 12:21:23.390616 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:23.905719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7316): Launched 12:21:24.196048 run osmo-stp_10.42.42.5(pid=7317): Launched 12:21:24.307057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:21:24.811079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7319): Launched 12:21:24.922924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:21:25.170024 run patchelf(pid=7320): Launched 12:21:25.332430 run osmo-stp_10.42.42.5(pid=7317): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7317)] 12:21:25.455957 run osmo-stp_10.42.42.5(pid=7317): stdout: | (launched: 2022-12-10_12:21:24.142999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:25.580509 run osmo-stp_10.42.42.5(pid=7317): stderr: | 20221210122124313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122124313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122124313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122124314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122124314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122124314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122124314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:25.705605 run osmo-stp_10.42.42.5(pid=7317): stdout: | (launched: 2022-12-10_12:21:24.142999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:25.825313 run osmo-stp_10.42.42.5(pid=7317): stderr: | 20221210122124313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122124313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122124313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122124314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122124314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122124314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122124314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:25.968286 run patchelf(pid=7320): Terminating (SIGINT) 12:21:26.131899 run patchelf(pid=7320): Terminated: ok {rc=0} 12:21:26.249434 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7317): Process ended prematurely: osmo-stp_10.42.42.5(pid=7317) [trial-2374↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7317)] [trial-2374↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:21:26.258238 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 12:21:26.284402 run osmo-hlr_10.42.42.2(pid=7314): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7314)] 12:21:26.331647 run osmo-hlr_10.42.42.2(pid=7314): stdout: | (launched: 2022-12-10_12:21:23.225214) 12:21:26.380116 run osmo-hlr_10.42.42.2(pid=7314): stderr: | 20221210122123400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122123400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122123400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122123400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122123400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122123400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122123411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122123420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122123420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122123420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:26.429122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7313): Terminating (SIGTERM) 12:21:26.467961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7316): Terminating (SIGTERM) 12:21:26.507018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7319): Terminating (SIGTERM) 12:21:26.546489 --- ParallelTerminationStrategy: PID 7313 died... 12:21:26.565487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7313): Terminated: ok {rc=0} 12:21:26.609231 --- ParallelTerminationStrategy: PID 7316 died... 12:21:26.627847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7316): Terminated: ok {rc=0} 12:21:26.671154 --- ParallelTerminationStrategy: PID 7319 died... 12:21:26.689597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7319): Terminated: ok {rc=0} 12:21:26.772572 bus /gobi_0: Setting Powered False 12:21:27.869203 bus /gobi_0: Setting Powered False 12:21:28.984374 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 sms:nanobts+band-900 --------------------------------------------------------------------- 12:21:30.232110 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:30.237212 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:21:30.272155 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:21:30.298366 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 12:21:30.349533 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:21:30.381179 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:21:30.407507 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 12:21:30.984807 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 12:21:30.990671 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:31.001792 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 12:21:31.057397 tst mo_mt_sms.py: using LAC 28360 12:21:31.202485 tst mo_mt_sms.py: using RAC 55 12:21:31.317428 tst mo_mt_sms.py: using CellId 28360 12:21:31.435280 tst mo_mt_sms.py: using BVCI 28361 12:21:31.580003 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:31.592424 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:31.610388 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:31.623299 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:31.636143 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:31.649360 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:21:31.768538 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:21:31.890432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:32.388656 run create_hlr_db(pid=7325): Launched 12:21:32.510979 bus /gobi_6: Setting Powered False 12:21:33.573604 run create_hlr_db(pid=7325): Terminated: ok {rc=0} 12:21:34.011030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7327): Launched 12:21:34.324627 run osmo-hlr_10.42.42.2(pid=7328): Launched 12:21:34.445640 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:34.988480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7330): Launched 12:21:35.301651 run osmo-stp_10.42.42.5(pid=7331): Launched 12:21:35.421703 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:35.989738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7333): Launched 12:21:36.303764 run osmo-msc_10.42.42.6(pid=7334): Launched 12:21:36.480596 run osmo-stp_10.42.42.5(pid=7331): ERR: Terminated: ERROR {rc=1} [trial-2374↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7331)] 12:21:36.614015 run osmo-stp_10.42.42.5(pid=7331): stdout: | (launched: 2022-12-10_12:21:35.244512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:36.747421 run osmo-stp_10.42.42.5(pid=7331): stderr: | 20221210122135434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122135435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122135435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122135435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122135437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122135438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122135438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:36.879594 run osmo-stp_10.42.42.5(pid=7331): stdout: | (launched: 2022-12-10_12:21:35.244512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:37.005215 run osmo-stp_10.42.42.5(pid=7331): stderr: | 20221210122135434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122135435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122135435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122135435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122135437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122135438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122135438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:37.154884 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7331): Process ended prematurely: osmo-stp_10.42.42.5(pid=7331) [trial-2374↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7331)] [trial-2374↪sms:nanobts+band-900↪mo_mt_sms.py:16] 12:21:37.163728 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 12:21:37.191497 run osmo-hlr_10.42.42.2(pid=7328): ERR: Terminated: ERROR {rc=237} [trial-2374↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7328)] 12:21:37.241495 run osmo-hlr_10.42.42.2(pid=7328): stdout: | (launched: 2022-12-10_12:21:34.267486) 12:21:37.292934 run osmo-hlr_10.42.42.2(pid=7328): stderr: | 20221210122134465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122134465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122134465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122134465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122134465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122134465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122134478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122134486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122134487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122134487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:37.364571 run osmo-msc_10.42.42.6(pid=7334): ERR: Terminated: ERROR {rc=2} [trial-2374↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7334)] 12:21:37.414356 run osmo-msc_10.42.42.6(pid=7334): stdout: | (launched: 2022-12-10_12:21:36.246588) 12:21:37.465492 run osmo-msc_10.42.42.6(pid=7334): stderr: | 20221210122136567 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122136567 DLGLOBAL DEBUG validating counter group 0x7fab37526c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122136567 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122136567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122136567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122136567 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122136569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122136570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122136570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122136570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:37.517253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7327): Terminating (SIGTERM) 12:21:37.558658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7330): Terminating (SIGTERM) 12:21:37.600566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7333): Terminating (SIGTERM) 12:21:37.642462 --- ParallelTerminationStrategy: PID 7327 died... 12:21:37.662297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7327): Terminated: ok {rc=0} 12:21:37.708339 --- ParallelTerminationStrategy: PID 7330 died... 12:21:37.727703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7330): Terminated: ok {rc=0} 12:21:37.773611 --- ParallelTerminationStrategy: PID 7333 died... 12:21:37.792770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7333): Terminated: ok {rc=0} 12:21:37.879879 bus /sierra_3: Setting Powered False 12:21:38.977387 bus /sierra_3: Setting Powered False 12:21:40.092493 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 12:21:41.322812 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:41.327531 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:21:41.358732 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 12:21:41.365289 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:21:41.399310 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:21:41.430687 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 12:21:41.437265 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:21:41.959043 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:21:41.964922 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 12:21:41.976269 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:21:42.023119 tst assert_extension.py: using LAC 28361 12:21:42.140450 tst assert_extension.py: using RAC 56 12:21:42.254756 tst assert_extension.py: using CellId 28361 12:21:42.380071 tst assert_extension.py: using BVCI 28362 12:21:42.485819 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:21:42.600376 tst assert_extension.py:10: start nitb and bts... 12:21:42.812399 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:21:43.452270 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7339): Launched 12:21:43.766620 run osmo-nitb_10.42.42.2(pid=7340): Launched 12:21:43.939608 run osmo-nitb_10.42.42.2(pid=7340): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7340)] 12:21:44.080067 run osmo-nitb_10.42.42.2(pid=7340): stdout: | (launched: 2022-12-10_12:21:43.709841) 12:21:44.221859 run osmo-nitb_10.42.42.2(pid=7340): stderr: | (launched: 2022-12-10_12:21:43.756175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:21:44.363938 run osmo-nitb_10.42.42.2(pid=7340): stdout: | (launched: 2022-12-10_12:21:43.709841) 12:21:44.500018 run osmo-nitb_10.42.42.2(pid=7340): stderr: | (launched: 2022-12-10_12:21:43.756175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7340): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7340) [trial-2374↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7340)] 12:21:44.884259 tst osmo-nitb_10.42.42.2(pid=7340): stdout: | (launched: 2022-12-10_12:21:43.709841) 12:21:45.011275 tst osmo-nitb_10.42.42.2(pid=7340): stderr: | (launched: 2022-12-10_12:21:43.756175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:21:45.161461 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7340): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7340) [trial-2374↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7340)] [trial-2374↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 12:21:45.170356 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:21:45.177309 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7339): Terminating (SIGTERM) 12:21:45.388215 --- ParallelTerminationStrategy: PID 7339 died... 12:21:45.409611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7339): Terminated: ok {rc=0} 12:21:45.496237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 ussd:nanobts+band-900 --------------------------------------------------------------------- 12:21:46.701064 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:46.709850 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:21:46.755933 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:21:46.790327 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:21:46.839360 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:21:46.892354 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:21:46.928570 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:21:47.423987 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:21:47.429114 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:47.440038 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:21:47.486696 tst assert_extension.py: using LAC 28362 12:21:47.602661 tst assert_extension.py: using RAC 57 12:21:47.721815 tst assert_extension.py: using CellId 28362 12:21:47.836490 tst assert_extension.py: using BVCI 28363 12:21:47.942355 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:47.952939 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:47.963534 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:47.974590 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:47.985663 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:21:47.996452 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:21:48.112474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:48.596671 run create_hlr_db(pid=7344): Launched 12:21:48.717412 bus /sierra_2: Setting Powered False 12:21:49.779904 run create_hlr_db(pid=7344): Terminated: ok {rc=0} 12:21:50.198752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Launched 12:21:50.490374 run osmo-hlr_10.42.42.2(pid=7347): Launched 12:21:50.602910 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:51.105365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Launched 12:21:51.398109 run osmo-stp_10.42.42.5(pid=7350): Launched 12:21:51.509929 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:52.069107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7352): Launched 12:21:52.381195 run osmo-msc_10.42.42.6(pid=7353): Launched 12:21:52.556748 run osmo-stp_10.42.42.5(pid=7350): ERR: Terminated: ERROR {rc=1} [trial-2374↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] 12:21:52.689743 run osmo-stp_10.42.42.5(pid=7350): stdout: | (launched: 2022-12-10_12:21:51.343895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:52.822853 run osmo-stp_10.42.42.5(pid=7350): stderr: | 20221210122151512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122151512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122151513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122151513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122151513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122151514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122151514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:52.954784 run osmo-stp_10.42.42.5(pid=7350): stdout: | (launched: 2022-12-10_12:21:51.343895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:53.080115 run osmo-stp_10.42.42.5(pid=7350): stderr: | 20221210122151512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122151512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122151513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122151513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122151513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122151514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122151514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:53.230045 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7350): Process ended prematurely: osmo-stp_10.42.42.5(pid=7350) [trial-2374↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] [trial-2374↪ussd:nanobts+band-900↪assert_extension.py:17] 12:21:53.238877 tst assert_extension.py:17: Test FAILED (5.8 sec) 12:21:53.266586 run osmo-hlr_10.42.42.2(pid=7347): ERR: Terminated: ERROR {rc=237} [trial-2374↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7347)] 12:21:53.316533 run osmo-hlr_10.42.42.2(pid=7347): stdout: | (launched: 2022-12-10_12:21:50.436822) 12:21:53.368607 run osmo-hlr_10.42.42.2(pid=7347): stderr: | 20221210122150610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122150610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122150610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122150610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122150610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122150610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122150634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122150643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122150643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122150643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:53.440634 run osmo-msc_10.42.42.6(pid=7353): ERR: Terminated: ERROR {rc=2} [trial-2374↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7353)] 12:21:53.490701 run osmo-msc_10.42.42.6(pid=7353): stdout: | (launched: 2022-12-10_12:21:52.324350) 12:21:53.542314 run osmo-msc_10.42.42.6(pid=7353): stderr: | 20221210122152644 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122152644 DLGLOBAL DEBUG validating counter group 0x7f710883ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122152644 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122152644 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122152644 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122152644 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122152646 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122152646 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122152647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122152647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:53.594428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Terminating (SIGTERM) 12:21:53.636345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Terminating (SIGTERM) 12:21:53.678499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7352): Terminating (SIGTERM) 12:21:53.720561 --- ParallelTerminationStrategy: PID 7346 died... 12:21:53.740338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Terminated: ok {rc=0} 12:21:53.786835 --- ParallelTerminationStrategy: PID 7349 died... 12:21:53.806384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Terminated: ok {rc=0} 12:21:53.852502 --- ParallelTerminationStrategy: PID 7352 died... 12:21:53.871982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7352): Terminated: ok {rc=0} 12:21:53.959205 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:21:55.169970 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:55.178342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:21:55.210136 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:21:55.236139 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:21:55.287135 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:21:55.318768 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:21:55.344705 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:21:55.899258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:21:55.953158 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:21:55.964574 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:21:56.032738 tst mo_mt_call.py: using LAC 28363 12:21:56.157541 tst mo_mt_call.py: using RAC 58 12:21:56.283510 tst mo_mt_call.py: using CellId 28363 12:21:56.407331 tst mo_mt_call.py: using BVCI 28364 12:21:56.522502 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:21:56.534271 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:21:56.545561 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:21:56.557079 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:21:56.568573 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:21:56.580575 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:21:56.694999 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:21:56.812515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:57.270127 run create_hlr_db(pid=7358): Launched 12:21:57.392136 bus /sierra_2: Setting Powered False 12:21:58.452437 run create_hlr_db(pid=7358): Terminated: ok {rc=0} 12:21:58.887556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7360): Launched 12:21:59.206677 run osmo-hlr_10.42.42.2(pid=7361): Launched 12:21:59.328499 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:59.879709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7363): Launched 12:22:00.198686 run osmo-stp_10.42.42.5(pid=7364): Launched 12:22:00.320568 run osmo-msc_10.42.42.6: Starting osmo-msc 12:22:00.906887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7366): Launched 12:22:01.250199 run osmo-msc_10.42.42.6(pid=7367): Launched 12:22:01.528133 run osmo-stp_10.42.42.5(pid=7364): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7364)] 12:22:01.682778 run osmo-stp_10.42.42.5(pid=7364): stdout: | (launched: 2022-12-10_12:22:00.140531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:01.930359 run osmo-stp_10.42.42.5(pid=7364): stderr: | 20221210122200330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122200330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122200330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122200331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122200331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122200331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122200331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:02.136487 run osmo-stp_10.42.42.5(pid=7364): stdout: | (launched: 2022-12-10_12:22:00.140531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:02.269228 run osmo-stp_10.42.42.5(pid=7364): stderr: | 20221210122200330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122200330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122200330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122200331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122200331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122200331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122200331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:02.427008 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7364): Process ended prematurely: osmo-stp_10.42.42.5(pid=7364) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7364)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:22:02.436369 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:22:02.465056 run osmo-hlr_10.42.42.2(pid=7361): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7361)] 12:22:02.515384 run osmo-hlr_10.42.42.2(pid=7361): stdout: | (launched: 2022-12-10_12:21:59.149005) 12:22:02.567488 run osmo-hlr_10.42.42.2(pid=7361): stderr: | 20221210122159346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122159346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122159346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122159346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122159346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122159346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122159363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122159373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122159373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122159373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:02.640528 run osmo-msc_10.42.42.6(pid=7367): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7367)] 12:22:02.691112 run osmo-msc_10.42.42.6(pid=7367): stdout: | (launched: 2022-12-10_12:22:01.186685) 12:22:02.743007 run osmo-msc_10.42.42.6(pid=7367): stderr: | 20221210122201785 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122201786 DLGLOBAL DEBUG validating counter group 0x7f581db74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122201786 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122201786 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122201786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122201787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122201791 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122201792 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122201792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122201792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:02.795507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7360): Terminating (SIGTERM) 12:22:02.837214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7363): Terminating (SIGTERM) 12:22:02.879147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7366): Terminating (SIGTERM) 12:22:02.921457 --- ParallelTerminationStrategy: PID 7360 died... 12:22:02.941455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7360): Terminated: ok {rc=0} 12:22:02.988034 --- ParallelTerminationStrategy: PID 7363 died... 12:22:03.007496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7363): Terminated: ok {rc=0} 12:22:03.054152 --- ParallelTerminationStrategy: PID 7366 died... 12:22:03.073771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7366): Terminated: ok {rc=0} 12:22:03.161451 bus /sierra_3: Setting Powered False 12:22:04.259663 bus /sierra_3: Setting Powered False 12:22:05.373643 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:22:06.521206 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:22:06.533417 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:22:06.604594 tst mo_mt_call_osmux.py: using LAC 28364 12:22:06.729291 tst mo_mt_call_osmux.py: using RAC 59 12:22:06.851324 tst mo_mt_call_osmux.py: using CellId 28364 12:22:06.973824 tst mo_mt_call_osmux.py: using BVCI 28365 12:22:07.088575 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:22:07.100089 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:22:07.111480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:22:07.123101 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:22:07.134758 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:22:07.146766 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:22:07.261480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:22:07.380504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:07.875171 run create_hlr_db(pid=7369): Launched 12:22:07.997161 bus /sierra_2: Setting Powered False 12:22:09.060186 run create_hlr_db(pid=7369): Terminated: ok {rc=0} 12:22:09.486222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Launched 12:22:09.783417 run osmo-hlr_10.42.42.2(pid=7372): Launched 12:22:09.896384 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:10.421767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Launched 12:22:10.720341 run osmo-stp_10.42.42.5(pid=7375): Launched 12:22:10.833478 run osmo-msc_10.42.42.6: Starting osmo-msc 12:22:11.371770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Launched 12:22:11.669085 run osmo-msc_10.42.42.6(pid=7378): Launched 12:22:11.835834 run osmo-stp_10.42.42.5(pid=7375): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] 12:22:11.962023 run osmo-stp_10.42.42.5(pid=7375): stdout: | (launched: 2022-12-10_12:22:10.665933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:12.087870 run osmo-stp_10.42.42.5(pid=7375): stderr: | 20221210122210835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122210835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122210835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122210836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122210836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122210836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122210836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:12.211981 run osmo-stp_10.42.42.5(pid=7375): stdout: | (launched: 2022-12-10_12:22:10.665933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:12.330840 run osmo-stp_10.42.42.5(pid=7375): stderr: | 20221210122210835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122210835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122210835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122210836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122210836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122210836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122210836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:12.472853 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7375): Process ended prematurely: osmo-stp_10.42.42.5(pid=7375) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:22:12.481951 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:22:12.508233 run osmo-hlr_10.42.42.2(pid=7372): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7372)] 12:22:12.554966 run osmo-hlr_10.42.42.2(pid=7372): stdout: | (launched: 2022-12-10_12:22:09.729347) 12:22:12.603572 run osmo-hlr_10.42.42.2(pid=7372): stderr: | 20221210122209904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122209904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122209904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122209904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122209904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122209904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122209916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122209925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122209926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122209926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:12.671646 run osmo-msc_10.42.42.6(pid=7378): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7378)] 12:22:12.718165 run osmo-msc_10.42.42.6(pid=7378): stdout: | (launched: 2022-12-10_12:22:11.614029) 12:22:12.766283 run osmo-msc_10.42.42.6(pid=7378): stderr: | 20221210122211887 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122211887 DLGLOBAL DEBUG validating counter group 0x7fd0afa97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122211888 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122211888 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122211888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122211888 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122211890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122211890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122211890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122211890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:12.814960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Terminating (SIGTERM) 12:22:12.853966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Terminating (SIGTERM) 12:22:12.893170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Terminating (SIGTERM) 12:22:12.932471 --- ParallelTerminationStrategy: PID 7371 died... 12:22:12.951336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Terminated: ok {rc=0} 12:22:12.994841 --- ParallelTerminationStrategy: PID 7374 died... 12:22:13.013205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Terminated: ok {rc=0} 12:22:13.056243 --- ParallelTerminationStrategy: PID 7377 died... 12:22:13.074703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Terminated: ok {rc=0} 12:22:13.158184 bus /sierra_3: Setting Powered False 12:22:14.258058 bus /sierra_3: Setting Powered False 12:22:15.371938 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:22:16.629606 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:22:16.638591 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:22:16.675362 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:22:16.705066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:22:16.761543 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:22:16.814196 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:22:16.846874 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:22:17.368544 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:22:17.416501 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:17.427577 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:22:17.492290 tst mo_mt_call.py: using LAC 28365 12:22:17.609308 tst mo_mt_call.py: using RAC 60 12:22:17.726930 tst mo_mt_call.py: using CellId 28365 12:22:17.842986 tst mo_mt_call.py: using BVCI 28366 12:22:17.950083 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:17.961120 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:17.971914 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:17.982699 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:17.993571 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:18.004352 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:22:18.121702 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:22:18.237959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:18.701331 run create_hlr_db(pid=7383): Launched 12:22:18.823197 bus /sierra_2: Setting Powered False 12:22:19.883740 run create_hlr_db(pid=7383): Terminated: ok {rc=0} 12:22:20.319632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7385): Launched 12:22:20.640630 run osmo-hlr_10.42.42.2(pid=7386): Launched 12:22:20.762658 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:21.313529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7388): Launched 12:22:21.633812 run osmo-stp_10.42.42.5(pid=7389): Launched 12:22:21.756157 run osmo-msc_10.42.42.6: Starting osmo-msc 12:22:22.332819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7391): Launched 12:22:22.652662 run osmo-msc_10.42.42.6(pid=7392): Launched 12:22:22.830805 run osmo-stp_10.42.42.5(pid=7389): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7389)] 12:22:22.965410 run osmo-stp_10.42.42.5(pid=7389): stdout: | (launched: 2022-12-10_12:22:21.574875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:23.100888 run osmo-stp_10.42.42.5(pid=7389): stderr: | 20221210122221768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122221769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122221769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122221769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122221770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122221770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122221770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:23.235823 run osmo-stp_10.42.42.5(pid=7389): stdout: | (launched: 2022-12-10_12:22:21.574875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:23.363228 run osmo-stp_10.42.42.5(pid=7389): stderr: | 20221210122221768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122221769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122221769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122221769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122221770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122221770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122221770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:23.516220 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7389): Process ended prematurely: osmo-stp_10.42.42.5(pid=7389) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7389)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:22:23.526023 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:22:23.554388 run osmo-hlr_10.42.42.2(pid=7386): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7386)] 12:22:23.604353 run osmo-hlr_10.42.42.2(pid=7386): stdout: | (launched: 2022-12-10_12:22:20.582255) 12:22:23.656320 run osmo-hlr_10.42.42.2(pid=7386): stderr: | 20221210122220780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122220780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122220780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122220780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122220780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122220780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122220792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122220801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122220801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122220801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:23.728840 run osmo-msc_10.42.42.6(pid=7392): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7392)] 12:22:23.778713 run osmo-msc_10.42.42.6(pid=7392): stdout: | (launched: 2022-12-10_12:22:22.594192) 12:22:23.830272 run osmo-msc_10.42.42.6(pid=7392): stderr: | 20221210122222915 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122222915 DLGLOBAL DEBUG validating counter group 0x7f5d8e8f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122222916 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122222916 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122222916 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122222916 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122222918 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122222918 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122222919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122222919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:23.882091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7385): Terminating (SIGTERM) 12:22:23.924241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7388): Terminating (SIGTERM) 12:22:23.966261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7391): Terminating (SIGTERM) 12:22:24.008600 --- ParallelTerminationStrategy: PID 7385 died... 12:22:24.028607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7385): Terminated: ok {rc=0} 12:22:24.075261 --- ParallelTerminationStrategy: PID 7388 died... 12:22:24.094837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7388): Terminated: ok {rc=0} 12:22:24.141185 --- ParallelTerminationStrategy: PID 7391 died... 12:22:24.160587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7391): Terminated: ok {rc=0} 12:22:24.249782 bus /sierra_3: Setting Powered False 12:22:25.348071 bus /sierra_3: Setting Powered False 12:22:26.463526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:22:27.613509 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:27.626175 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:22:27.693656 tst mo_mt_call_osmux.py: using LAC 28366 12:22:27.821375 tst mo_mt_call_osmux.py: using RAC 61 12:22:27.946308 tst mo_mt_call_osmux.py: using CellId 28366 12:22:28.068943 tst mo_mt_call_osmux.py: using BVCI 28367 12:22:28.184394 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:28.195833 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:28.207120 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:28.218663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:28.230423 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:22:28.242047 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:22:28.359032 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:22:28.472513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:28.933123 run create_hlr_db(pid=7394): Launched 12:22:29.055240 bus /sierra_2: Setting Powered False 12:22:30.114533 run create_hlr_db(pid=7394): Terminated: ok {rc=0} 12:22:30.551765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7396): Launched 12:22:30.881378 run osmo-hlr_10.42.42.2(pid=7397): Launched 12:22:31.108075 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:31.763861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7399): Launched 12:22:32.108434 run osmo-stp_10.42.42.5(pid=7400): Launched 12:22:32.300499 run osmo-msc_10.42.42.6: Starting osmo-msc 12:22:32.838516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7402): Launched 12:22:33.135810 run osmo-msc_10.42.42.6(pid=7403): Launched 12:22:33.303257 run osmo-stp_10.42.42.5(pid=7400): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7400)] 12:22:33.428141 run osmo-stp_10.42.42.5(pid=7400): stdout: | (launched: 2022-12-10_12:22:32.039972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:33.554188 run osmo-stp_10.42.42.5(pid=7400): stderr: | 20221210122232267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122232268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122232268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122232268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122232269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122232269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122232269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:33.677672 run osmo-stp_10.42.42.5(pid=7400): stdout: | (launched: 2022-12-10_12:22:32.039972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:33.795486 run osmo-stp_10.42.42.5(pid=7400): stderr: | 20221210122232267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122232268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122232268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122232268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122232269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122232269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122232269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:33.937451 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7400): Process ended prematurely: osmo-stp_10.42.42.5(pid=7400) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7400)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:22:33.946092 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:22:33.971943 run osmo-hlr_10.42.42.2(pid=7397): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7397)] 12:22:34.018545 run osmo-hlr_10.42.42.2(pid=7397): stdout: | (launched: 2022-12-10_12:22:30.814394) 12:22:34.067276 run osmo-hlr_10.42.42.2(pid=7397): stderr: | 20221210122231100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122231100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122231100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122231100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122231100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122231100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122231119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122231136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122231136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122231136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:34.134853 run osmo-msc_10.42.42.6(pid=7403): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7403)] 12:22:34.181430 run osmo-msc_10.42.42.6(pid=7403): stdout: | (launched: 2022-12-10_12:22:33.081367) 12:22:34.229564 run osmo-msc_10.42.42.6(pid=7403): stderr: | 20221210122233355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122233355 DLGLOBAL DEBUG validating counter group 0x7f3d7b72bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122233355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122233355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122233355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122233356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122233357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122233358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122233358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122233358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:34.278054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7396): Terminating (SIGTERM) 12:22:34.317509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7399): Terminating (SIGTERM) 12:22:34.356175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7402): Terminating (SIGTERM) 12:22:34.395596 --- ParallelTerminationStrategy: PID 7396 died... 12:22:34.414445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7396): Terminated: ok {rc=0} 12:22:34.457510 --- ParallelTerminationStrategy: PID 7399 died... 12:22:34.475607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7399): Terminated: ok {rc=0} 12:22:34.518802 --- ParallelTerminationStrategy: PID 7402 died... 12:22:34.537095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7402): Terminated: ok {rc=0} 12:22:34.619967 bus /sierra_3: Setting Powered False 12:22:35.716847 bus /sierra_3: Setting Powered False 12:22:36.833674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:22:38.085351 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:22:38.093347 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:22:38.126768 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:22:38.154066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:22:38.207165 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:22:38.239473 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:22:38.265665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:22:38.816292 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:22:38.863973 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:38.875108 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:22:38.941970 tst mo_mt_call.py: using LAC 28367 12:22:39.071136 tst mo_mt_call.py: using RAC 62 12:22:39.186980 tst mo_mt_call.py: using CellId 28367 12:22:39.301847 tst mo_mt_call.py: using BVCI 28368 12:22:39.410445 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:39.421413 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:39.432130 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:39.442938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:39.453829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:39.464505 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:22:39.581958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:22:39.701545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:40.196274 run create_hlr_db(pid=7409): Launched 12:22:40.319252 bus /sierra_2: Setting Powered False 12:22:41.383030 run create_hlr_db(pid=7409): Terminated: ok {rc=0} 12:22:41.827591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7411): Launched 12:22:42.146332 run osmo-hlr_10.42.42.2(pid=7412): Launched 12:22:42.268351 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:42.819720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7414): Launched 12:22:43.139140 run osmo-stp_10.42.42.5(pid=7415): Launched 12:22:43.261504 run osmo-msc_10.42.42.6: Starting osmo-msc 12:22:43.837428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7417): Launched 12:22:44.154898 run osmo-msc_10.42.42.6(pid=7418): Launched 12:22:44.332721 run osmo-stp_10.42.42.5(pid=7415): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7415)] 12:22:44.467869 run osmo-stp_10.42.42.5(pid=7415): stdout: | (launched: 2022-12-10_12:22:43.081223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:44.604590 run osmo-stp_10.42.42.5(pid=7415): stderr: | 20221210122243273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122243273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122243273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122243273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122243274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122243274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122243274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:44.739398 run osmo-stp_10.42.42.5(pid=7415): stdout: | (launched: 2022-12-10_12:22:43.081223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:44.866881 run osmo-stp_10.42.42.5(pid=7415): stderr: | 20221210122243273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122243273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122243273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122243273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122243274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122243274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122243274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:45.019702 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7415): Process ended prematurely: osmo-stp_10.42.42.5(pid=7415) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7415)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:22:45.029202 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:22:45.057415 run osmo-hlr_10.42.42.2(pid=7412): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7412)] 12:22:45.107087 run osmo-hlr_10.42.42.2(pid=7412): stdout: | (launched: 2022-12-10_12:22:42.088390) 12:22:45.158524 run osmo-hlr_10.42.42.2(pid=7412): stderr: | 20221210122242285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122242285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122242285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122242285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122242285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122242285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122242297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122242305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122242306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122242306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:45.230205 run osmo-msc_10.42.42.6(pid=7418): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7418)] 12:22:45.279921 run osmo-msc_10.42.42.6(pid=7418): stdout: | (launched: 2022-12-10_12:22:44.097165) 12:22:45.331036 run osmo-msc_10.42.42.6(pid=7418): stderr: | 20221210122244416 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122244416 DLGLOBAL DEBUG validating counter group 0x7fd1a9a6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122244417 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122244417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122244417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122244417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122244420 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122244421 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122244421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122244421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:45.382621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7411): Terminating (SIGTERM) 12:22:45.423863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7414): Terminating (SIGTERM) 12:22:45.465430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7417): Terminating (SIGTERM) 12:22:45.507439 --- ParallelTerminationStrategy: PID 7411 died... 12:22:45.527225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7411): Terminated: ok {rc=0} 12:22:45.573479 --- ParallelTerminationStrategy: PID 7414 died... 12:22:45.592592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7414): Terminated: ok {rc=0} 12:22:45.639091 --- ParallelTerminationStrategy: PID 7417 died... 12:22:45.658450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7417): Terminated: ok {rc=0} 12:22:45.746631 bus /sierra_3: Setting Powered False 12:22:46.843135 bus /sierra_3: Setting Powered False 12:22:47.955611 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:22:49.103754 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:49.115820 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:22:49.184339 tst mo_mt_call_osmux.py: using LAC 28368 12:22:49.314038 tst mo_mt_call_osmux.py: using RAC 63 12:22:49.438825 tst mo_mt_call_osmux.py: using CellId 28368 12:22:49.561860 tst mo_mt_call_osmux.py: using BVCI 28369 12:22:49.678285 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:49.689969 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:49.701396 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:49.713081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:49.724790 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:22:49.736741 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:22:49.855687 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:22:49.972846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:50.435831 run create_hlr_db(pid=7420): Launched 12:22:50.559857 bus /sierra_2: Setting Powered False 12:22:51.620012 run create_hlr_db(pid=7420): Terminated: ok {rc=0} 12:22:52.057745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7422): Launched 12:22:52.378211 run osmo-hlr_10.42.42.2(pid=7423): Launched 12:22:52.499963 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:53.050838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7425): Launched 12:22:53.371485 run osmo-stp_10.42.42.5(pid=7426): Launched 12:22:53.494022 run osmo-msc_10.42.42.6: Starting osmo-msc 12:22:54.069920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7428): Launched 12:22:54.389743 run osmo-msc_10.42.42.6(pid=7429): Launched 12:22:54.567592 run osmo-stp_10.42.42.5(pid=7426): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7426)] 12:22:54.703166 run osmo-stp_10.42.42.5(pid=7426): stdout: | (launched: 2022-12-10_12:22:53.313333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:54.838073 run osmo-stp_10.42.42.5(pid=7426): stderr: | 20221210122253506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122253506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122253506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122253506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122253507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122253507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122253507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:54.972342 run osmo-stp_10.42.42.5(pid=7426): stdout: | (launched: 2022-12-10_12:22:53.313333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:55.100597 run osmo-stp_10.42.42.5(pid=7426): stderr: | 20221210122253506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122253506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122253506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122253506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122253507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122253507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122253507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:55.253386 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7426): Process ended prematurely: osmo-stp_10.42.42.5(pid=7426) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7426)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:22:55.262833 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:22:55.291204 run osmo-hlr_10.42.42.2(pid=7423): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7423)] 12:22:55.340840 run osmo-hlr_10.42.42.2(pid=7423): stdout: | (launched: 2022-12-10_12:22:52.320044) 12:22:55.392489 run osmo-hlr_10.42.42.2(pid=7423): stderr: | 20221210122252517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122252517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122252517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122252517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122252517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122252517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122252529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122252538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122252538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122252538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:55.464100 run osmo-msc_10.42.42.6(pid=7429): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7429)] 12:22:55.513784 run osmo-msc_10.42.42.6(pid=7429): stdout: | (launched: 2022-12-10_12:22:54.331884) 12:22:55.565128 run osmo-msc_10.42.42.6(pid=7429): stderr: | 20221210122254653 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122254653 DLGLOBAL DEBUG validating counter group 0x7f39aca30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122254654 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122254654 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122254654 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122254654 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122254656 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122254656 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122254656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122254656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:55.616772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7422): Terminating (SIGTERM) 12:22:55.658885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7425): Terminating (SIGTERM) 12:22:55.700711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7428): Terminating (SIGTERM) 12:22:55.742748 --- ParallelTerminationStrategy: PID 7422 died... 12:22:55.762546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7422): Terminated: ok {rc=0} 12:22:55.808891 --- ParallelTerminationStrategy: PID 7425 died... 12:22:55.828480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7425): Terminated: ok {rc=0} 12:22:55.874751 --- ParallelTerminationStrategy: PID 7428 died... 12:22:55.894337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7428): Terminated: ok {rc=0} 12:22:55.982684 bus /sierra_3: Setting Powered False 12:22:57.080666 bus /sierra_3: Setting Powered False 12:22:58.195088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:22:59.435964 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:22:59.442996 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:22:59.474237 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:22:59.500180 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:22:59.550768 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:22:59.581758 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:22:59.607437 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:23:00.162727 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:23:00.215495 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:00.227170 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:23:00.294830 tst mo_mt_call.py: using LAC 28369 12:23:00.418631 tst mo_mt_call.py: using RAC 64 12:23:00.542302 tst mo_mt_call.py: using CellId 28369 12:23:00.667589 tst mo_mt_call.py: using BVCI 28370 12:23:00.776165 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:00.787124 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:00.797937 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:00.808781 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:00.823692 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:00.846083 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:23:00.982921 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:23:01.104565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:01.586826 run create_hlr_db(pid=7435): Launched 12:23:01.744566 bus /sierra_2: Setting Powered False 12:23:02.804768 run create_hlr_db(pid=7435): Terminated: ok {rc=0} 12:23:03.239002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7437): Launched 12:23:03.558656 run osmo-hlr_10.42.42.2(pid=7438): Launched 12:23:03.681112 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:04.231417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7440): Launched 12:23:04.533673 run osmo-stp_10.42.42.5(pid=7441): Launched 12:23:04.648056 run osmo-msc_10.42.42.6: Starting osmo-msc 12:23:05.187385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7443): Launched 12:23:05.484249 run osmo-msc_10.42.42.6(pid=7444): Launched 12:23:05.650422 run osmo-stp_10.42.42.5(pid=7441): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7441)] 12:23:05.776279 run osmo-stp_10.42.42.5(pid=7441): stdout: | (launched: 2022-12-10_12:23:04.478503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:05.901812 run osmo-stp_10.42.42.5(pid=7441): stderr: | 20221210122304650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122304651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122304651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122304651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122304652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122304652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122304652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:06.025770 run osmo-stp_10.42.42.5(pid=7441): stdout: | (launched: 2022-12-10_12:23:04.478503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:06.143998 run osmo-stp_10.42.42.5(pid=7441): stderr: | 20221210122304650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122304651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122304651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122304651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122304652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122304652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122304652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:06.286729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7441): Process ended prematurely: osmo-stp_10.42.42.5(pid=7441) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7441)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:23:06.295661 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:23:06.321953 run osmo-hlr_10.42.42.2(pid=7438): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7438)] 12:23:06.369228 run osmo-hlr_10.42.42.2(pid=7438): stdout: | (launched: 2022-12-10_12:23:03.500126) 12:23:06.418236 run osmo-hlr_10.42.42.2(pid=7438): stderr: | 20221210122303698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122303698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122303698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122303698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122303698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122303699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122303711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122303719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122303719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122303719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:06.486953 run osmo-msc_10.42.42.6(pid=7444): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7444)] 12:23:06.534495 run osmo-msc_10.42.42.6(pid=7444): stdout: | (launched: 2022-12-10_12:23:05.429998) 12:23:06.583260 run osmo-msc_10.42.42.6(pid=7444): stderr: | 20221210122305702 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122305702 DLGLOBAL DEBUG validating counter group 0x7f21fa97ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122305702 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122305702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122305702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122305703 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122305704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122305705 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122305705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122305705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:23:06.632303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7437): Terminating (SIGTERM) 12:23:06.672016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7440): Terminating (SIGTERM) 12:23:06.711008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7443): Terminating (SIGTERM) 12:23:06.750333 --- ParallelTerminationStrategy: PID 7437 died... 12:23:06.769221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7437): Terminated: ok {rc=0} 12:23:06.812652 --- ParallelTerminationStrategy: PID 7440 died... 12:23:06.831018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7440): Terminated: ok {rc=0} 12:23:06.874892 --- ParallelTerminationStrategy: PID 7443 died... 12:23:06.893247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7443): Terminated: ok {rc=0} 12:23:06.975896 bus /sierra_3: Setting Powered False 12:23:08.073822 bus /sierra_3: Setting Powered False 12:23:09.189616 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:23:10.337661 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:10.349930 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:23:10.422154 tst mo_mt_call_osmux.py: using LAC 28370 12:23:10.547356 tst mo_mt_call_osmux.py: using RAC 65 12:23:10.674566 tst mo_mt_call_osmux.py: using CellId 28370 12:23:10.800492 tst mo_mt_call_osmux.py: using BVCI 28371 12:23:10.916553 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:10.928204 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:10.939586 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:10.951253 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:10.962940 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:23:10.975095 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:23:11.091293 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:23:11.208570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:11.702180 run create_hlr_db(pid=7446): Launched 12:23:11.823724 bus /sierra_2: Setting Powered False 12:23:12.886943 run create_hlr_db(pid=7446): Terminated: ok {rc=0} 12:23:13.330906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7448): Launched 12:23:13.650529 run osmo-hlr_10.42.42.2(pid=7449): Launched 12:23:13.773462 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:14.325287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7451): Launched 12:23:14.645548 run osmo-stp_10.42.42.5(pid=7452): Launched 12:23:14.767838 run osmo-msc_10.42.42.6: Starting osmo-msc 12:23:15.343389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7454): Launched 12:23:15.662720 run osmo-msc_10.42.42.6(pid=7455): Launched 12:23:15.867689 run osmo-stp_10.42.42.5(pid=7452): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7452)] 12:23:16.082259 run osmo-stp_10.42.42.5(pid=7452): stdout: | (launched: 2022-12-10_12:23:14.587505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:16.287177 run osmo-stp_10.42.42.5(pid=7452): stderr: | 20221210122314780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122314780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122314781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122314781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122314782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122314782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122314782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:16.482741 run osmo-stp_10.42.42.5(pid=7452): stdout: | (launched: 2022-12-10_12:23:14.587505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:16.635950 run osmo-stp_10.42.42.5(pid=7452): stderr: | 20221210122314780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122314780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122314781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122314781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122314782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122314782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122314782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:16.824232 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7452): Process ended prematurely: osmo-stp_10.42.42.5(pid=7452) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7452)] [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:23:16.834793 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:23:16.866186 run osmo-hlr_10.42.42.2(pid=7449): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7449)] 12:23:16.924393 run osmo-hlr_10.42.42.2(pid=7449): stdout: | (launched: 2022-12-10_12:23:13.592516) 12:23:16.982881 run osmo-hlr_10.42.42.2(pid=7449): stderr: | 20221210122313788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122313788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122313788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122313788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122313788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122313788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122313801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122313809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122313809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122313809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:17.073749 run osmo-msc_10.42.42.6(pid=7455): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7455)] 12:23:17.138922 run osmo-msc_10.42.42.6(pid=7455): stdout: | (launched: 2022-12-10_12:23:15.604436) 12:23:17.206327 run osmo-msc_10.42.42.6(pid=7455): stderr: | 20221210122316048 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122316055 DLGLOBAL DEBUG validating counter group 0x7f92d7e0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122316055 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122316055 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122316055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122316055 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122316057 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122316058 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122316058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122316058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:23:17.269109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7448): Terminating (SIGTERM) 12:23:17.313257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7451): Terminating (SIGTERM) 12:23:17.357512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7454): Terminating (SIGTERM) 12:23:17.402993 --- ParallelTerminationStrategy: PID 7448 died... 12:23:17.430345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7448): Terminated: ok {rc=0} 12:23:17.481526 --- ParallelTerminationStrategy: PID 7451 died... 12:23:17.504614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7451): Terminated: ok {rc=0} 12:23:17.562165 --- ParallelTerminationStrategy: PID 7454 died... 12:23:17.582671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7454): Terminated: ok {rc=0} 12:23:17.681872 bus /sierra_3: Setting Powered False 12:23:18.805507 bus /sierra_3: Setting Powered False 12:23:19.919299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:23:21.171635 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:23:21.180172 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:23:21.217410 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:23:21.246768 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:23:21.299393 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:23:21.334152 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:23:21.363223 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:23:21.912902 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:23:21.967994 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:21.980466 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:23:22.052077 tst mo_mt_call.py: using LAC 28371 12:23:22.178471 tst mo_mt_call.py: using RAC 66 12:23:22.308516 tst mo_mt_call.py: using CellId 28371 12:23:22.439812 tst mo_mt_call.py: using BVCI 28372 12:23:22.558877 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:22.571283 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:22.585118 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:22.598535 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:22.612826 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:22.625082 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:23:22.750589 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:23:22.877571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:23.390505 run create_hlr_db(pid=7731): Launched 12:23:23.554795 bus /sierra_2: Setting Powered False 12:23:24.621254 run create_hlr_db(pid=7731): Terminated: ok {rc=0} 12:23:25.088138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7733): Launched 12:23:25.441673 run osmo-hlr_10.42.42.2(pid=7734): Launched 12:23:25.689444 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:26.365414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7736): Launched 12:23:26.716673 run osmo-stp_10.42.42.5(pid=7737): Launched 12:23:26.964866 run osmo-msc_10.42.42.6: Starting osmo-msc 12:23:27.649688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7739): Launched 12:23:27.997651 run osmo-msc_10.42.42.6(pid=7740): Launched 12:23:28.354385 run osmo-stp_10.42.42.5(pid=7737): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7737)] 12:23:28.646210 run osmo-stp_10.42.42.5(pid=7737): stdout: | (launched: 2022-12-10_12:23:26.647633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:28.810193 run osmo-stp_10.42.42.5(pid=7737): stderr: | 20221210122326950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122326950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122326950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122326951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122326951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122326951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122326951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:28.948792 run osmo-stp_10.42.42.5(pid=7737): stdout: | (launched: 2022-12-10_12:23:26.647633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:29.081782 run osmo-stp_10.42.42.5(pid=7737): stderr: | 20221210122326950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122326950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122326950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122326951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122326951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122326951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122326951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:29.240567 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7737): Process ended prematurely: osmo-stp_10.42.42.5(pid=7737) [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7737)] [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:23:29.251169 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 12:23:29.282750 run osmo-hlr_10.42.42.2(pid=7734): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7734)] 12:23:29.335830 run osmo-hlr_10.42.42.2(pid=7734): stdout: | (launched: 2022-12-10_12:23:25.369237) 12:23:29.390576 run osmo-hlr_10.42.42.2(pid=7734): stderr: | 20221210122325681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122325681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122325681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122325681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122325681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122325681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122325699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122325712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122325712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122325712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:29.467225 run osmo-msc_10.42.42.6(pid=7740): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7740)] 12:23:29.519935 run osmo-msc_10.42.42.6(pid=7740): stdout: | (launched: 2022-12-10_12:23:27.926653) 12:23:29.574708 run osmo-msc_10.42.42.6(pid=7740): stderr: | 20221210122328427 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122328428 DLGLOBAL DEBUG validating counter group 0x7ffb35ff8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122328428 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122328428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122328428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122328428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122328438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122328439 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122328439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122328439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:23:29.630956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7733): Terminating (SIGTERM) 12:23:29.676683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7736): Terminating (SIGTERM) 12:23:29.723471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7739): Terminating (SIGTERM) 12:23:29.770087 --- ParallelTerminationStrategy: PID 7733 died... 12:23:29.790939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7733): Terminated: ok {rc=0} 12:23:29.843369 --- ParallelTerminationStrategy: PID 7736 died... 12:23:29.863985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7736): Terminated: ok {rc=0} 12:23:29.913506 --- ParallelTerminationStrategy: PID 7739 died... 12:23:29.934092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7739): Terminated: ok {rc=0} 12:23:30.027399 bus /sierra_3: Setting Powered False 12:23:31.146682 bus /sierra_3: Setting Powered False 12:23:32.297023 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:23:33.463183 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:33.476435 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:23:33.548292 tst mo_mt_call_osmux.py: using LAC 28372 12:23:33.679908 tst mo_mt_call_osmux.py: using RAC 67 12:23:33.809378 tst mo_mt_call_osmux.py: using CellId 28372 12:23:33.938164 tst mo_mt_call_osmux.py: using BVCI 28373 12:23:34.058872 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:34.071742 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:34.084135 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:34.098789 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:34.112505 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:23:34.124810 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:23:34.250803 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:23:34.376396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:34.899088 run create_hlr_db(pid=7742): Launched 12:23:35.064134 bus /sierra_2: Setting Powered False 12:23:36.129483 run create_hlr_db(pid=7742): Terminated: ok {rc=0} 12:23:36.598127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7744): Launched 12:23:36.947990 run osmo-hlr_10.42.42.2(pid=7745): Launched 12:23:37.203434 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:37.882880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7747): Launched 12:23:38.233705 run osmo-stp_10.42.42.5(pid=7748): Launched 12:23:38.466680 run osmo-msc_10.42.42.6: Starting osmo-msc 12:23:39.062336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7751): Launched 12:23:39.382989 run osmo-msc_10.42.42.6(pid=7752): Launched 12:23:39.562284 run osmo-stp_10.42.42.5(pid=7748): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7748)] 12:23:39.697525 run osmo-stp_10.42.42.5(pid=7748): stdout: | (launched: 2022-12-10_12:23:38.159572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:39.833066 run osmo-stp_10.42.42.5(pid=7748): stderr: | 20221210122338464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122338464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122338464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122338464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122338469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122338469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122338469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:39.967530 run osmo-stp_10.42.42.5(pid=7748): stdout: | (launched: 2022-12-10_12:23:38.159572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:40.095277 run osmo-stp_10.42.42.5(pid=7748): stderr: | 20221210122338464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122338464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122338464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122338464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122338469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122338469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122338469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:40.248533 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7748): Process ended prematurely: osmo-stp_10.42.42.5(pid=7748) [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7748)] [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:23:40.258183 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 12:23:40.286944 run osmo-hlr_10.42.42.2(pid=7745): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7745)] 12:23:40.337221 run osmo-hlr_10.42.42.2(pid=7745): stdout: | (launched: 2022-12-10_12:23:36.881732) 12:23:40.388878 run osmo-hlr_10.42.42.2(pid=7745): stderr: | 20221210122337200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122337200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122337200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122337200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122337200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122337200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122337220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122337228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122337228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122337228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:40.460833 run osmo-msc_10.42.42.6(pid=7752): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7752)] 12:23:40.511248 run osmo-msc_10.42.42.6(pid=7752): stdout: | (launched: 2022-12-10_12:23:39.324502) 12:23:40.563252 run osmo-msc_10.42.42.6(pid=7752): stderr: | 20221210122339644 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122339644 DLGLOBAL DEBUG validating counter group 0x7f198bc50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122339645 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122339645 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122339645 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122339645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122339647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122339647 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122339647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122339647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:23:40.615644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7744): Terminating (SIGTERM) 12:23:40.657853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7747): Terminating (SIGTERM) 12:23:40.699793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7751): Terminating (SIGTERM) 12:23:40.742436 --- ParallelTerminationStrategy: PID 7744 died... 12:23:40.762324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7744): Terminated: ok {rc=0} 12:23:40.808767 --- ParallelTerminationStrategy: PID 7747 died... 12:23:40.828273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7747): Terminated: ok {rc=0} 12:23:40.874708 --- ParallelTerminationStrategy: PID 7751 died... 12:23:40.894309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7751): Terminated: ok {rc=0} 12:23:40.981407 bus /sierra_3: Setting Powered False 12:23:42.079703 bus /sierra_3: Setting Powered False 12:23:43.192390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:23:44.436637 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:23:44.443366 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:23:44.474949 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 12:23:44.500927 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 12:23:44.551032 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:23:44.582450 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 12:23:44.608499 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 12:23:45.161976 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 12:23:45.217625 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:45.229646 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:23:45.280521 tst mo_mt_call.py: using LAC 28373 12:23:45.406598 tst mo_mt_call.py: using RAC 68 12:23:45.533623 tst mo_mt_call.py: using CellId 28373 12:23:45.661333 tst mo_mt_call.py: using BVCI 28374 12:23:45.778403 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:45.790051 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:45.801472 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:45.813257 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:45.825021 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:45.846359 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:23:45.979085 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:23:46.097814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:46.585640 run create_hlr_db(pid=7757): Launched 12:23:46.747009 bus /sierra_2: Setting Powered False 12:23:47.807000 run create_hlr_db(pid=7757): Terminated: ok {rc=0} 12:23:48.282222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7759): Launched 12:23:48.601307 run osmo-hlr_10.42.42.2(pid=7760): Launched 12:23:48.723444 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:49.274747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7762): Launched 12:23:49.594576 run osmo-stp_10.42.42.5(pid=7763): Launched 12:23:49.716708 run osmo-msc_10.42.42.6: Starting osmo-msc 12:23:50.293937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7765): Launched 12:23:50.612368 run osmo-msc_10.42.42.6(pid=7766): Launched 12:23:50.790420 run osmo-stp_10.42.42.5(pid=7763): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7763)] 12:23:50.925797 run osmo-stp_10.42.42.5(pid=7763): stdout: | (launched: 2022-12-10_12:23:49.536588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:51.061486 run osmo-stp_10.42.42.5(pid=7763): stderr: | 20221210122349730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122349730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122349731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122349731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122349731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122349731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122349731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:51.195668 run osmo-stp_10.42.42.5(pid=7763): stdout: | (launched: 2022-12-10_12:23:49.536588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:51.323567 run osmo-stp_10.42.42.5(pid=7763): stderr: | 20221210122349730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122349730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122349731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122349731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122349731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122349731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122349731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:51.475940 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7763): Process ended prematurely: osmo-stp_10.42.42.5(pid=7763) [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7763)] [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 12:23:51.485658 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:23:51.513962 run osmo-hlr_10.42.42.2(pid=7760): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7760)] 12:23:51.563713 run osmo-hlr_10.42.42.2(pid=7760): stdout: | (launched: 2022-12-10_12:23:48.543134) 12:23:51.615046 run osmo-hlr_10.42.42.2(pid=7760): stderr: | 20221210122348743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122348743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122348744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122348744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122348744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122348744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122348755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122348764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122348764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122348764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:51.686801 run osmo-msc_10.42.42.6(pid=7766): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7766)] 12:23:51.736576 run osmo-msc_10.42.42.6(pid=7766): stdout: | (launched: 2022-12-10_12:23:50.553883) 12:23:51.787686 run osmo-msc_10.42.42.6(pid=7766): stderr: | 20221210122350875 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122350876 DLGLOBAL DEBUG validating counter group 0x7fd580c76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122350876 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122350876 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122350876 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122350876 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122350878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122350878 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122350878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122350879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:23:51.839211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7759): Terminating (SIGTERM) 12:23:51.880704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7762): Terminating (SIGTERM) 12:23:51.922505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7765): Terminating (SIGTERM) 12:23:51.964402 --- ParallelTerminationStrategy: PID 7759 died... 12:23:51.984256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7759): Terminated: ok {rc=0} 12:23:52.030773 --- ParallelTerminationStrategy: PID 7762 died... 12:23:52.050302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7762): Terminated: ok {rc=0} 12:23:52.096378 --- ParallelTerminationStrategy: PID 7765 died... 12:23:52.115929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7765): Terminated: ok {rc=0} 12:23:52.203368 bus /sierra_3: Setting Powered False 12:23:53.301262 bus /sierra_3: Setting Powered False 12:23:54.418578 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 12:23:55.563172 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:55.575169 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:23:55.624942 tst mo_mt_call_osmux.py: using LAC 28374 12:23:55.752461 tst mo_mt_call_osmux.py: using RAC 69 12:23:55.877675 tst mo_mt_call_osmux.py: using CellId 28374 12:23:56.002401 tst mo_mt_call_osmux.py: using BVCI 28375 12:23:56.120693 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:56.132659 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:56.144401 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:56.156183 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:56.168103 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:23:56.179834 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:23:56.296351 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:23:56.411325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:56.873734 run create_hlr_db(pid=7768): Launched 12:23:56.995877 bus /sierra_2: Setting Powered False 12:23:58.054852 run create_hlr_db(pid=7768): Terminated: ok {rc=0} 12:23:58.470160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7770): Launched 12:23:58.767048 run osmo-hlr_10.42.42.2(pid=7771): Launched 12:23:58.880262 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:59.408820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7773): Launched 12:23:59.706132 run osmo-stp_10.42.42.5(pid=7774): Launched 12:23:59.818574 run osmo-msc_10.42.42.6: Starting osmo-msc 12:24:00.355213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7776): Launched 12:24:00.653380 run osmo-msc_10.42.42.6(pid=7777): Launched 12:24:00.820559 run osmo-stp_10.42.42.5(pid=7774): ERR: Terminated: ERROR {rc=1} [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7774)] 12:24:01.083489 run osmo-stp_10.42.42.5(pid=7774): stdout: | (launched: 2022-12-10_12:23:59.651886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:01.230296 run osmo-stp_10.42.42.5(pid=7774): stderr: | 20221210122359822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122359822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122359823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122359823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122359824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122359824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122359824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:01.360016 run osmo-stp_10.42.42.5(pid=7774): stdout: | (launched: 2022-12-10_12:23:59.651886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:01.482121 run osmo-stp_10.42.42.5(pid=7774): stderr: | 20221210122359822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122359822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122359823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122359823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122359824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122359824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122359824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:01.627675 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7774): Process ended prematurely: osmo-stp_10.42.42.5(pid=7774) [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7774)] [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 12:24:01.637626 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:24:01.665395 run osmo-hlr_10.42.42.2(pid=7771): ERR: Terminated: ERROR {rc=237} [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7771)] 12:24:01.713304 run osmo-hlr_10.42.42.2(pid=7771): stdout: | (launched: 2022-12-10_12:23:58.712688) 12:24:01.763409 run osmo-hlr_10.42.42.2(pid=7771): stderr: | 20221210122358890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122358890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122358890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122358890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122358890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122358890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122358903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122358913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122358913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122358913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:01.834042 run osmo-msc_10.42.42.6(pid=7777): ERR: Terminated: ERROR {rc=2} [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7777)] 12:24:01.883135 run osmo-msc_10.42.42.6(pid=7777): stdout: | (launched: 2022-12-10_12:24:00.598760) 12:24:01.932446 run osmo-msc_10.42.42.6(pid=7777): stderr: | 20221210122400904 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122400905 DLGLOBAL DEBUG validating counter group 0x7f67a1cbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122400905 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122400905 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122400905 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122400905 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122400907 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122400907 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122400907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122400907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:24:01.982698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7770): Terminating (SIGTERM) 12:24:02.039133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7773): Terminating (SIGTERM) 12:24:02.087485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7776): Terminating (SIGTERM) 12:24:02.130150 --- ParallelTerminationStrategy: PID 7770 died... 12:24:02.149409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7770): Terminated: ok {rc=0} 12:24:02.194827 --- ParallelTerminationStrategy: PID 7773 died... 12:24:02.214065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7773): Terminated: ok {rc=0} 12:24:02.259204 --- ParallelTerminationStrategy: PID 7776 died... 12:24:02.278762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7776): Terminated: ok {rc=0} 12:24:02.364476 bus /sierra_3: Setting Powered False 12:24:03.461807 bus /sierra_3: Setting Powered False 12:24:04.576293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 emergency:nanobts+band-900 --------------------------------------------------------------------- 12:24:05.837994 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:24:05.843963 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:24:05.877295 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:24:05.904325 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:24:05.989832 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:24:06.022256 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:24:06.049181 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:24:06.638673 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2374 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 12:24:06.643772 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:06.654818 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:24:06.703933 tst emergency_mo_mt_call.py: using LAC 28375 12:24:06.829374 tst emergency_mo_mt_call.py: using RAC 70 12:24:06.953637 tst emergency_mo_mt_call.py: using CellId 28375 12:24:07.074128 tst emergency_mo_mt_call.py: using BVCI 28376 12:24:07.187752 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:07.198933 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:07.209851 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:07.220892 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:07.232076 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:07.243252 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:07.355532 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:07.471537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:07.956702 run create_hlr_db(pid=7782): Launched 12:24:08.076211 bus /sierra_2: Setting Powered False 12:24:09.139590 run create_hlr_db(pid=7782): Terminated: ok {rc=0} 12:24:09.559225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7784): Launched 12:24:09.851434 run osmo-hlr_10.42.42.2(pid=7785): Launched 12:24:09.963148 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:10.467174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7787): Launched 12:24:10.758523 run osmo-stp_10.42.42.5(pid=7788): Launched 12:24:10.879497 tst emergency_mo_mt_call.py: using MSISDN 7728 12:24:11.029254 run osmo-msc_10.42.42.6: Starting osmo-msc 12:24:11.555666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7790): Launched 12:24:11.847754 run osmo-msc_10.42.42.6(pid=7791): Launched 12:24:12.012575 run osmo-stp_10.42.42.5(pid=7788): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7788)] 12:24:12.136180 run osmo-stp_10.42.42.5(pid=7788): stdout: | (launched: 2022-12-10_12:24:10.705034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:12.259695 run osmo-stp_10.42.42.5(pid=7788): stderr: | 20221210122410874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122410874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122410874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122410875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122410875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122410875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122410875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:12.380737 run osmo-stp_10.42.42.5(pid=7788): stdout: | (launched: 2022-12-10_12:24:10.705034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:12.497854 run osmo-stp_10.42.42.5(pid=7788): stderr: | 20221210122410874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122410874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122410874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122410875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122410875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122410875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122410875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:12.636894 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7788): Process ended prematurely: osmo-stp_10.42.42.5(pid=7788) [trial-2374↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7788)] [trial-2374↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 12:24:12.645104 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 12:24:12.671156 run osmo-hlr_10.42.42.2(pid=7785): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7785)] 12:24:12.718082 run osmo-hlr_10.42.42.2(pid=7785): stdout: | (launched: 2022-12-10_12:24:09.797708) 12:24:12.766871 run osmo-hlr_10.42.42.2(pid=7785): stderr: | 20221210122409972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122409972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122409972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122409972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122409972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122409972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122409984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122409993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122409993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122409993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:12.834753 run osmo-msc_10.42.42.6(pid=7791): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7791)] 12:24:12.881743 run osmo-msc_10.42.42.6(pid=7791): stdout: | (launched: 2022-12-10_12:24:11.793852) 12:24:12.930254 run osmo-msc_10.42.42.6(pid=7791): stderr: | 20221210122412065 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122412065 DLGLOBAL DEBUG validating counter group 0x7f81194eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122412065 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122412066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122412066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122412066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122412068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122412068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122412068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122412068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:24:12.979632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7784): Terminating (SIGTERM) 12:24:13.018614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7787): Terminating (SIGTERM) 12:24:13.057513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7790): Terminating (SIGTERM) 12:24:13.096700 --- ParallelTerminationStrategy: PID 7784 died... 12:24:13.115543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7784): Terminated: ok {rc=0} 12:24:13.159193 --- ParallelTerminationStrategy: PID 7787 died... 12:24:13.178196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7787): Terminated: ok {rc=0} 12:24:13.221981 --- ParallelTerminationStrategy: PID 7790 died... 12:24:13.240570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7790): Terminated: ok {rc=0} 12:24:13.326561 bus /sierra_3: Setting Powered False 12:24:14.426033 bus /sierra_3: Setting Powered False 12:24:15.538221 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 12:24:16.626103 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:16.638472 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:24:16.695604 tst emergency_preemptive_call.py: using LAC 28376 12:24:16.846548 tst emergency_preemptive_call.py: using RAC 71 12:24:16.999635 tst emergency_preemptive_call.py: using CellId 28376 12:24:17.117014 tst emergency_preemptive_call.py: using BVCI 28377 12:24:17.225106 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:17.236171 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:17.247121 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:17.258517 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:17.269426 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:24:17.280154 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:17.393339 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:17.506924 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:17.618662 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:17.730156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:18.184878 run create_hlr_db(pid=7793): Launched 12:24:18.308176 bus /sierra_2: Setting Powered False 12:24:19.370130 run create_hlr_db(pid=7793): Terminated: ok {rc=0} 12:24:19.810492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7795): Launched 12:24:20.125024 run osmo-hlr_10.42.42.2(pid=7796): Launched 12:24:20.246155 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:20.790893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7798): Launched 12:24:21.105723 run osmo-stp_10.42.42.5(pid=7799): Launched 12:24:21.235215 tst emergency_preemptive_call.py: using MSISDN 7729 12:24:21.397694 run osmo-msc_10.42.42.6: Starting osmo-msc 12:24:21.962029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7801): Launched 12:24:22.276864 run osmo-msc_10.42.42.6(pid=7802): Launched 12:24:22.453105 run osmo-stp_10.42.42.5(pid=7799): ERR: Terminated: ERROR {rc=1} [trial-2374↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7799)] 12:24:22.586574 run osmo-stp_10.42.42.5(pid=7799): stdout: | (launched: 2022-12-10_12:24:21.048153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:22.720628 run osmo-stp_10.42.42.5(pid=7799): stderr: | 20221210122421242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122421242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122421242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122421243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122421243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122421243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122421243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:22.853777 run osmo-stp_10.42.42.5(pid=7799): stdout: | (launched: 2022-12-10_12:24:21.048153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:22.980360 run osmo-stp_10.42.42.5(pid=7799): stderr: | 20221210122421242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122421242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122421242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122421243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122421243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122421243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122421243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:23.131689 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7799): Process ended prematurely: osmo-stp_10.42.42.5(pid=7799) [trial-2374↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7799)] [trial-2374↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 12:24:23.140693 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 12:24:23.168505 run osmo-hlr_10.42.42.2(pid=7796): ERR: Terminated: ERROR {rc=237} [trial-2374↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7796)] 12:24:23.218421 run osmo-hlr_10.42.42.2(pid=7796): stdout: | (launched: 2022-12-10_12:24:20.067872) 12:24:23.270343 run osmo-hlr_10.42.42.2(pid=7796): stderr: | 20221210122420265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122420265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122420265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122420265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122420265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122420265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122420277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122420285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122420285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122420286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:23.342623 run osmo-msc_10.42.42.6(pid=7802): ERR: Terminated: ERROR {rc=2} [trial-2374↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7802)] 12:24:23.392496 run osmo-msc_10.42.42.6(pid=7802): stdout: | (launched: 2022-12-10_12:24:22.219400) 12:24:23.444134 run osmo-msc_10.42.42.6(pid=7802): stderr: | 20221210122422542 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122422542 DLGLOBAL DEBUG validating counter group 0x7f863027cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122422542 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122422542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122422542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122422542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122422544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122422545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122422545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122422545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:24:23.496208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7795): Terminating (SIGTERM) 12:24:23.537922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7798): Terminating (SIGTERM) 12:24:23.579756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7801): Terminating (SIGTERM) 12:24:23.621683 --- ParallelTerminationStrategy: PID 7795 died... 12:24:23.641577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7795): Terminated: ok {rc=0} 12:24:23.688714 --- ParallelTerminationStrategy: PID 7798 died... 12:24:23.708403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7798): Terminated: ok {rc=0} 12:24:23.754831 --- ParallelTerminationStrategy: PID 7801 died... 12:24:23.774569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7801): Terminated: ok {rc=0} 12:24:23.862852 bus /sierra_9: Setting Powered False 12:24:24.961807 bus /sierra_9: Setting Powered False 12:24:26.077119 bus /sierra_8: Setting Powered False 12:24:27.174485 bus /sierra_8: Setting Powered False 12:24:28.289592 bus /sierra_3: Setting Powered False 12:24:29.386209 bus /sierra_3: Setting Powered False 12:24:30.504250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900 --------------------------------------------------------------------- 12:24:31.784290 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:24:31.790034 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:24:31.822514 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 12:24:31.860939 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:24:31.948336 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:24:31.982965 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 12:24:32.025504 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:24:32.608018 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 12:24:32.656450 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:32.667104 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:24:32.711633 tst cs_paging_gprs_active.py: using LAC 28377 12:24:32.826831 tst cs_paging_gprs_active.py: using RAC 72 12:24:32.941754 tst cs_paging_gprs_active.py: using CellId 28377 12:24:33.057543 tst cs_paging_gprs_active.py: using BVCI 28378 12:24:33.167192 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.177835 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.188158 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.198703 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.208933 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.219263 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.229962 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.240109 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:33.250618 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:33.368240 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:33.489604 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:24:33.707365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:34.029900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7807): Launched 12:24:34.310378 run iperf3-srv_10.42.42.10(pid=7808): Launched 12:24:34.431217 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:24:34.648311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:34.970406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7809): Launched 12:24:35.249910 run iperf3-srv_10.42.42.10(pid=7810): Launched 12:24:35.370333 tst cs_paging_gprs_active.py:38: start network... 12:24:35.587761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:36.084659 run create_hlr_db(pid=7811): Launched 12:24:36.207632 bus /sierra_2: Setting Powered False 12:24:37.272189 run create_hlr_db(pid=7811): Terminated: ok {rc=0} 12:24:37.719535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7813): Launched 12:24:38.040223 run osmo-hlr_10.42.42.2(pid=7814): Launched 12:24:38.162785 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:38.711627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7816): Launched 12:24:39.031523 run osmo-stp_10.42.42.5(pid=7817): Launched 12:24:39.154280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:39.708608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7819): Launched 12:24:39.831755 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:40.102935 run patchelf(pid=7820): Launched 12:24:40.282288 run osmo-stp_10.42.42.5(pid=7817): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7817)] 12:24:40.418273 run osmo-stp_10.42.42.5(pid=7817): stdout: | (launched: 2022-12-10_12:24:38.973368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:40.555785 run osmo-stp_10.42.42.5(pid=7817): stderr: | 20221210122439166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122439166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122439166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122439167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122439167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122439167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122439167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:40.694397 run osmo-stp_10.42.42.5(pid=7817): stdout: | (launched: 2022-12-10_12:24:38.973368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:40.826205 run osmo-stp_10.42.42.5(pid=7817): stderr: | 20221210122439166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122439166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122439166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122439167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122439167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122439167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122439167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:40.982011 run patchelf(pid=7820): Terminating (SIGINT) 12:24:41.162293 run patchelf(pid=7820): Terminated: ok {rc=0} 12:24:41.292346 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7817): Process ended prematurely: osmo-stp_10.42.42.5(pid=7817) [trial-2374↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7817)] [trial-2374↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 12:24:41.302494 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:24:41.331146 run osmo-hlr_10.42.42.2(pid=7814): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7814)] 12:24:41.381178 run osmo-hlr_10.42.42.2(pid=7814): stdout: | (launched: 2022-12-10_12:24:37.982203) 12:24:41.432701 run osmo-hlr_10.42.42.2(pid=7814): stderr: | 20221210122438180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122438180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122438180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122438180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122438180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122438180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122438192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122438200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122438200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122438200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:41.484413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7807): Terminating (SIGTERM) 12:24:41.526211 run iperf3-srv_10.42.42.10(pid=7808): Terminating (SIGTERM) 12:24:41.567627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7809): Terminating (SIGTERM) 12:24:41.609393 run iperf3-srv_10.42.42.10(pid=7810): Terminating (SIGTERM) 12:24:41.651490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7813): Terminating (SIGTERM) 12:24:41.693601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7816): Terminating (SIGTERM) 12:24:41.735377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7819): Terminating (SIGTERM) 12:24:41.777483 --- ParallelTerminationStrategy: PID 7807 died... 12:24:41.797317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7807): Terminated: ok {rc=0} 12:24:41.844270 --- ParallelTerminationStrategy: PID 7808 died... 12:24:41.863555 run iperf3-srv_10.42.42.10(pid=7808): Terminated {rc=256} 12:24:41.909856 --- ParallelTerminationStrategy: PID 7809 died... 12:24:41.929297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7809): Terminated: ok {rc=0} 12:24:41.975314 --- ParallelTerminationStrategy: PID 7810 died... 12:24:41.994662 run iperf3-srv_10.42.42.10(pid=7810): Terminated {rc=256} 12:24:42.040845 --- ParallelTerminationStrategy: PID 7813 died... 12:24:42.060711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7813): Terminated: ok {rc=0} 12:24:42.106873 --- ParallelTerminationStrategy: PID 7816 died... 12:24:42.126458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7816): Terminated: ok {rc=0} 12:24:42.173311 --- ParallelTerminationStrategy: PID 7819 died... 12:24:42.192838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7819): Terminated: ok {rc=0} 12:24:42.281752 bus /gobi_0: Setting Powered False 12:24:43.380738 bus /gobi_0: Setting Powered False 12:24:44.497341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 12:24:45.645151 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:45.657228 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:24:45.709279 tst iperf3.py: using LAC 28378 12:24:45.840228 tst iperf3.py: using RAC 73 12:24:45.982021 tst iperf3.py: using CellId 28378 12:24:46.129929 tst iperf3.py: using BVCI 28379 12:24:46.244652 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.255763 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.266767 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.277916 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.288668 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.299901 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.310991 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.322199 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:46.333177 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:46.449623 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:46.695610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:47.027278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7821): Launched 12:24:47.325719 run iperf3-srv_10.42.42.10(pid=7822): Launched 12:24:47.450530 tst iperf3.py:8: start network... 12:24:47.666910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:48.163951 run create_hlr_db(pid=7824): Launched 12:24:48.286002 bus /gobi_6: Setting Powered False 12:24:49.349813 run create_hlr_db(pid=7824): Terminated: ok {rc=0} 12:24:49.779879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7826): Launched 12:24:50.079998 run osmo-hlr_10.42.42.2(pid=7827): Launched 12:24:50.194581 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:50.710341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7829): Launched 12:24:51.008340 run osmo-stp_10.42.42.5(pid=7830): Launched 12:24:51.123003 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:51.638168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7832): Launched 12:24:51.751989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:52.004201 run patchelf(pid=7833): Launched 12:24:52.170900 run osmo-stp_10.42.42.5(pid=7830): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7830)] 12:24:52.297117 run osmo-stp_10.42.42.5(pid=7830): stdout: | (launched: 2022-12-10_12:24:50.953439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:52.424767 run osmo-stp_10.42.42.5(pid=7830): stderr: | 20221210122451125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122451125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122451125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122451126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122451126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122451126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122451126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:52.553268 run osmo-stp_10.42.42.5(pid=7830): stdout: | (launched: 2022-12-10_12:24:50.953439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:52.675755 run osmo-stp_10.42.42.5(pid=7830): stderr: | 20221210122451125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122451125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122451125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122451126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122451126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122451126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122451126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:52.820617 run patchelf(pid=7833): Terminating (SIGINT) 12:24:52.988372 run patchelf(pid=7833): Terminated: ok {rc=0} 12:24:53.108894 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7830): Process ended prematurely: osmo-stp_10.42.42.5(pid=7830) [trial-2374↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7830)] [trial-2374↪gprs:nanobts+band-900↪iperf3.py:8] 12:24:53.118283 tst iperf3.py:8: Test FAILED (7.5 sec) 12:24:53.145065 run osmo-hlr_10.42.42.2(pid=7827): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7827)] 12:24:53.192804 run osmo-hlr_10.42.42.2(pid=7827): stdout: | (launched: 2022-12-10_12:24:50.025235) 12:24:53.241835 run osmo-hlr_10.42.42.2(pid=7827): stderr: | 20221210122450201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122450201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122450201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122450201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122450201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122450202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122450213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122450223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122450224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122450224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:53.291448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7821): Terminating (SIGTERM) 12:24:53.331104 run iperf3-srv_10.42.42.10(pid=7822): Terminating (SIGTERM) 12:24:53.370672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7826): Terminating (SIGTERM) 12:24:53.410255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7829): Terminating (SIGTERM) 12:24:53.450357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7832): Terminating (SIGTERM) 12:24:53.490379 --- ParallelTerminationStrategy: PID 7821 died... 12:24:53.509468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7821): Terminated: ok {rc=0} 12:24:53.553353 --- ParallelTerminationStrategy: PID 7822 died... 12:24:53.571752 run iperf3-srv_10.42.42.10(pid=7822): Terminated {rc=256} 12:24:53.615557 --- ParallelTerminationStrategy: PID 7826 died... 12:24:53.634094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7826): Terminated: ok {rc=0} 12:24:53.677727 --- ParallelTerminationStrategy: PID 7829 died... 12:24:53.696092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7829): Terminated: ok {rc=0} 12:24:53.740094 --- ParallelTerminationStrategy: PID 7832 died... 12:24:53.758618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7832): Terminated: ok {rc=0} 12:24:53.844304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 12:24:54.989702 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.000709 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:24:55.049309 tst iperf3m4.py: using LAC 28379 12:24:55.171473 tst iperf3m4.py: using RAC 74 12:24:55.288376 tst iperf3m4.py: using CellId 28379 12:24:55.403775 tst iperf3m4.py: using BVCI 28380 12:24:55.511969 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.522648 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.533024 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.543665 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.553998 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.564589 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.575070 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.585374 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:24:55.595801 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:55.713270 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:55.828670 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:55.946797 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:24:56.064554 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:56.266521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:56.566173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7834): Launched 12:24:56.826720 run iperf3-srv_10.42.42.10(pid=7835): Launched 12:24:56.938859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:24:57.139138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:57.438569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7836): Launched 12:24:57.699423 run iperf3-srv_10.42.42.10(pid=7837): Launched 12:24:57.811667 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:24:58.010994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:58.310079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7838): Launched 12:24:58.569513 run iperf3-srv_10.42.42.10(pid=7839): Launched 12:24:58.680901 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:24:58.880929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:59.180012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7840): Launched 12:24:59.440200 run iperf3-srv_10.42.42.10(pid=7841): Launched 12:24:59.553087 tst iperf3m4.py:8: start network... 12:24:59.753176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:00.215179 run create_hlr_db(pid=7842): Launched 12:25:00.338773 bus /gobi_6: Setting Powered False 12:25:01.397028 run create_hlr_db(pid=7842): Terminated: ok {rc=0} 12:25:01.837079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7847): Launched 12:25:02.164313 run osmo-hlr_10.42.42.2(pid=7848): Launched 12:25:02.314846 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:02.872211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7850): Launched 12:25:03.194288 run osmo-stp_10.42.42.5(pid=7851): Launched 12:25:03.317037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:03.870628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7853): Launched 12:25:03.993502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:04.264632 run patchelf(pid=7854): Launched 12:25:04.443251 run osmo-stp_10.42.42.5(pid=7851): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7851)] 12:25:04.579672 run osmo-stp_10.42.42.5(pid=7851): stdout: | (launched: 2022-12-10_12:25:03.135758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:04.718211 run osmo-stp_10.42.42.5(pid=7851): stderr: | 20221210122503328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122503328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122503328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122503329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122503329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122503329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122503329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:04.856385 run osmo-stp_10.42.42.5(pid=7851): stdout: | (launched: 2022-12-10_12:25:03.135758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:04.988570 run osmo-stp_10.42.42.5(pid=7851): stderr: | 20221210122503328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122503328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122503328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122503329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122503329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122503329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122503329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:05.145589 run patchelf(pid=7854): Terminating (SIGINT) 12:25:05.325915 run patchelf(pid=7854): Terminated: ok {rc=0} 12:25:05.455142 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7851): Process ended prematurely: osmo-stp_10.42.42.5(pid=7851) [trial-2374↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7851)] [trial-2374↪gprs:nanobts+band-900↪iperf3m4.py:8] 12:25:05.465269 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:25:05.494839 run osmo-hlr_10.42.42.2(pid=7848): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7848)] 12:25:05.545439 run osmo-hlr_10.42.42.2(pid=7848): stdout: | (launched: 2022-12-10_12:25:02.097633) 12:25:05.597316 run osmo-hlr_10.42.42.2(pid=7848): stderr: | 20221210122502322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122502322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122502322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122502322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122502322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122502322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122502355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122502364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122502365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122502365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:05.649842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7834): Terminating (SIGTERM) 12:25:05.691747 run iperf3-srv_10.42.42.10(pid=7835): Terminating (SIGTERM) 12:25:05.733852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7836): Terminating (SIGTERM) 12:25:05.775845 run iperf3-srv_10.42.42.10(pid=7837): Terminating (SIGTERM) 12:25:05.818758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7838): Terminating (SIGTERM) 12:25:05.861305 run iperf3-srv_10.42.42.10(pid=7839): Terminating (SIGTERM) 12:25:05.900827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7840): Terminating (SIGTERM) 12:25:05.940688 run iperf3-srv_10.42.42.10(pid=7841): Terminating (SIGTERM) 12:25:05.980043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7847): Terminating (SIGTERM) 12:25:06.019617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7850): Terminating (SIGTERM) 12:25:06.059037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7853): Terminating (SIGTERM) 12:25:06.098622 --- ParallelTerminationStrategy: PID 7834 died... 12:25:06.118001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7834): Terminated: ok {rc=0} 12:25:06.162691 --- ParallelTerminationStrategy: PID 7835 died... 12:25:06.180931 run iperf3-srv_10.42.42.10(pid=7835): Terminated {rc=256} 12:25:06.225317 --- ParallelTerminationStrategy: PID 7836 died... 12:25:06.243540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7836): Terminated: ok {rc=0} 12:25:06.286708 --- ParallelTerminationStrategy: PID 7837 died... 12:25:06.304891 run iperf3-srv_10.42.42.10(pid=7837): Terminated {rc=256} 12:25:06.347760 --- ParallelTerminationStrategy: PID 7838 died... 12:25:06.366015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7838): Terminated: ok {rc=0} 12:25:06.409200 --- ParallelTerminationStrategy: PID 7839 died... 12:25:06.427431 run iperf3-srv_10.42.42.10(pid=7839): Terminated {rc=256} 12:25:06.470349 --- ParallelTerminationStrategy: PID 7840 died... 12:25:06.488712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7840): Terminated: ok {rc=0} 12:25:06.531976 --- ParallelTerminationStrategy: PID 7841 died... 12:25:06.550205 run iperf3-srv_10.42.42.10(pid=7841): Terminated {rc=256} 12:25:06.593863 --- ParallelTerminationStrategy: PID 7847 died... 12:25:06.612132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7847): Terminated: ok {rc=0} 12:25:06.655381 --- ParallelTerminationStrategy: PID 7850 died... 12:25:06.673860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7850): Terminated: ok {rc=0} 12:25:06.717031 --- ParallelTerminationStrategy: PID 7853 died... 12:25:06.735506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7853): Terminated: ok {rc=0} 12:25:06.820192 bus /gobi_4: Setting Powered False 12:25:07.920443 bus /gobi_4: Setting Powered False 12:25:09.036344 bus /gobi_1: Setting Powered False 12:25:10.134657 bus /gobi_1: Setting Powered False 12:25:11.250262 bus /gobi_0: Setting Powered False 12:25:12.348898 bus /gobi_0: Setting Powered False 12:25:13.468325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900 ping.py ---------------------------------------------- 12:25:14.570975 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:14.582167 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:25:14.629522 tst ping.py: using LAC 28380 12:25:14.755592 tst ping.py: using RAC 75 12:25:14.879549 tst ping.py: using CellId 28380 12:25:15.002401 tst ping.py: using BVCI 28381 12:25:15.117056 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:15.128205 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:15.139391 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:15.150569 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:15.161707 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:15.172771 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:15.183987 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:15.195129 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:25:15.308924 tst ping.py:19: start network... 12:25:15.506030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:15.991910 run create_hlr_db(pid=7855): Launched 12:25:16.143793 bus /gobi_6: Setting Powered False 12:25:17.208726 run create_hlr_db(pid=7855): Terminated: ok {rc=0} 12:25:17.644194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7857): Launched 12:25:17.960599 run osmo-hlr_10.42.42.2(pid=7858): Launched 12:25:18.081687 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:18.630060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7860): Launched 12:25:18.944490 run osmo-stp_10.42.42.5(pid=7861): Launched 12:25:19.065463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:19.609324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7863): Launched 12:25:19.730318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:19.997857 run patchelf(pid=7864): Launched 12:25:20.173477 run osmo-stp_10.42.42.5(pid=7861): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7861)] 12:25:20.307082 run osmo-stp_10.42.42.5(pid=7861): stdout: | (launched: 2022-12-10_12:25:18.887000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:20.442020 run osmo-stp_10.42.42.5(pid=7861): stderr: | 20221210122519079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122519079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122519079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122519080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122519080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122519080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122519080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:20.577200 run osmo-stp_10.42.42.5(pid=7861): stdout: | (launched: 2022-12-10_12:25:18.887000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:20.706642 run osmo-stp_10.42.42.5(pid=7861): stderr: | 20221210122519079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122519079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122519079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122519080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122519080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122519080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122519080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:20.859734 run patchelf(pid=7864): Terminating (SIGINT) 12:25:21.036459 run patchelf(pid=7864): Terminated: ok {rc=0} 12:25:21.163928 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7861): Process ended prematurely: osmo-stp_10.42.42.5(pid=7861) [trial-2374↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7861)] [trial-2374↪gprs:nanobts+band-900↪ping.py:22] 12:25:21.173345 tst ping.py:22: Test FAILED (6.6 sec) 12:25:21.202094 run osmo-hlr_10.42.42.2(pid=7858): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7858)] 12:25:21.252859 run osmo-hlr_10.42.42.2(pid=7858): stdout: | (launched: 2022-12-10_12:25:17.903110) 12:25:21.305149 run osmo-hlr_10.42.42.2(pid=7858): stderr: | 20221210122518099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122518099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122518099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122518100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122518100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122518100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122518112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122518120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122518120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122518120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:21.357704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7857): Terminating (SIGTERM) 12:25:21.399820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7860): Terminating (SIGTERM) 12:25:21.441917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7863): Terminating (SIGTERM) 12:25:21.484356 --- ParallelTerminationStrategy: PID 7857 died... 12:25:21.504527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7857): Terminated: ok {rc=0} 12:25:21.551706 --- ParallelTerminationStrategy: PID 7860 died... 12:25:21.571592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7860): Terminated: ok {rc=0} 12:25:21.618727 --- ParallelTerminationStrategy: PID 7863 died... 12:25:21.638491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7863): Terminated: ok {rc=0} 12:25:21.727219 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 12:25:22.814838 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:22.826528 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:25:22.875137 tst ping_idle_ping.py: using LAC 28381 12:25:22.993353 tst ping_idle_ping.py: using RAC 76 12:25:23.109373 tst ping_idle_ping.py: using CellId 28381 12:25:23.224902 tst ping_idle_ping.py: using BVCI 28382 12:25:23.332665 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:23.343261 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:23.354242 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:23.364544 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:23.374883 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:23.385207 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:23.395625 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:25:23.406170 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:25:23.522111 tst ping_idle_ping.py:24: start network... 12:25:23.736655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:24.231179 run create_hlr_db(pid=7865): Launched 12:25:24.352707 bus /gobi_6: Setting Powered False 12:25:25.416058 run create_hlr_db(pid=7865): Terminated: ok {rc=0} 12:25:25.841248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7867): Launched 12:25:26.137177 run osmo-hlr_10.42.42.2(pid=7868): Launched 12:25:26.250559 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:26.758359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7870): Launched 12:25:27.052643 run osmo-stp_10.42.42.5(pid=7871): Launched 12:25:27.166256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:27.675437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7873): Launched 12:25:27.788568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:28.037452 run patchelf(pid=7874): Launched 12:25:28.201985 run osmo-stp_10.42.42.5(pid=7871): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7871)] 12:25:28.326699 run osmo-stp_10.42.42.5(pid=7871): stdout: | (launched: 2022-12-10_12:25:26.998630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:28.453740 run osmo-stp_10.42.42.5(pid=7871): stderr: | 20221210122527167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122527167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122527168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122527168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122527169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122527169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122527169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:28.580018 run osmo-stp_10.42.42.5(pid=7871): stdout: | (launched: 2022-12-10_12:25:26.998630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:28.700435 run osmo-stp_10.42.42.5(pid=7871): stderr: | 20221210122527167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122527167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122527168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122527168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122527169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122527169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122527169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:28.843289 run patchelf(pid=7874): Terminating (SIGINT) 12:25:29.008778 run patchelf(pid=7874): Terminated: ok {rc=0} 12:25:29.127824 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7871): Process ended prematurely: osmo-stp_10.42.42.5(pid=7871) [trial-2374↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7871)] [trial-2374↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 12:25:29.136673 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 12:25:29.163393 run osmo-hlr_10.42.42.2(pid=7868): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7868)] 12:25:29.210596 run osmo-hlr_10.42.42.2(pid=7868): stdout: | (launched: 2022-12-10_12:25:26.082578) 12:25:29.259414 run osmo-hlr_10.42.42.2(pid=7868): stderr: | 20221210122526257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122526257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122526257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122526257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122526257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122526257 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122526269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122526279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122526279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122526280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:29.308723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7867): Terminating (SIGTERM) 12:25:29.348348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7870): Terminating (SIGTERM) 12:25:29.387941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7873): Terminating (SIGTERM) 12:25:29.427804 --- ParallelTerminationStrategy: PID 7867 died... 12:25:29.446866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7867): Terminated: ok {rc=0} 12:25:29.490656 --- ParallelTerminationStrategy: PID 7870 died... 12:25:29.509308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7870): Terminated: ok {rc=0} 12:25:29.553779 --- ParallelTerminationStrategy: PID 7873 died... 12:25:29.572462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7873): Terminated: ok {rc=0} 12:25:29.655418 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 12:25:30.985491 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:30.992921 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:25:31.038503 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:25:31.080003 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:25:31.170644 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:25:31.206622 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:25:31.251880 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:25:31.884494 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:25:31.936472 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:31.948056 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:25:31.999599 tst cs_paging_gprs_active.py: using LAC 28382 12:25:32.118076 tst cs_paging_gprs_active.py: using RAC 77 12:25:32.243258 tst cs_paging_gprs_active.py: using CellId 28382 12:25:32.361000 tst cs_paging_gprs_active.py: using BVCI 28383 12:25:32.469474 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.480231 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.490831 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.501423 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.511887 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.522453 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.533102 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.543519 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:32.554425 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:25:32.672448 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:25:32.788451 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:25:32.990999 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:33.294799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7880): Launched 12:25:33.555941 run iperf3-srv_10.42.42.10(pid=7881): Launched 12:25:33.668403 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:25:33.870341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:34.170972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7882): Launched 12:25:34.431550 run iperf3-srv_10.42.42.10(pid=7883): Launched 12:25:34.543424 tst cs_paging_gprs_active.py:38: start network... 12:25:34.743696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:35.206263 run create_hlr_db(pid=7884): Launched 12:25:35.328227 bus /gobi_6: Setting Powered False 12:25:36.389231 run create_hlr_db(pid=7884): Terminated: ok {rc=0} 12:25:36.829692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7886): Launched 12:25:37.151030 run osmo-hlr_10.42.42.2(pid=7887): Launched 12:25:37.273875 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:37.830553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7889): Launched 12:25:38.153459 run osmo-stp_10.42.42.5(pid=7890): Launched 12:25:38.277074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:38.833049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7892): Launched 12:25:38.956384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:39.230021 run patchelf(pid=7893): Launched 12:25:39.409553 run osmo-stp_10.42.42.5(pid=7890): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7890)] 12:25:39.546682 run osmo-stp_10.42.42.5(pid=7890): stdout: | (launched: 2022-12-10_12:25:38.095157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:39.685419 run osmo-stp_10.42.42.5(pid=7890): stderr: | 20221210122538288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122538288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122538289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122538289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122538289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122538290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122538290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:39.824701 run osmo-stp_10.42.42.5(pid=7890): stdout: | (launched: 2022-12-10_12:25:38.095157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:39.957483 run osmo-stp_10.42.42.5(pid=7890): stderr: | 20221210122538288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122538288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122538289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122538289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122538289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122538290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122538290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:40.114694 run patchelf(pid=7893): Terminating (SIGINT) 12:25:40.295282 run patchelf(pid=7893): Terminated: ok {rc=0} 12:25:40.425516 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7890): Process ended prematurely: osmo-stp_10.42.42.5(pid=7890) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7890)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:25:40.435663 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 12:25:40.464933 run osmo-hlr_10.42.42.2(pid=7887): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7887)] 12:25:40.515264 run osmo-hlr_10.42.42.2(pid=7887): stdout: | (launched: 2022-12-10_12:25:37.092872) 12:25:40.567420 run osmo-hlr_10.42.42.2(pid=7887): stderr: | 20221210122537290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122537290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122537290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122537290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122537290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122537290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122537302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122537310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122537310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122537310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:40.619943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7880): Terminating (SIGTERM) 12:25:40.662355 run iperf3-srv_10.42.42.10(pid=7881): Terminating (SIGTERM) 12:25:40.704281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7882): Terminating (SIGTERM) 12:25:40.746612 run iperf3-srv_10.42.42.10(pid=7883): Terminating (SIGTERM) 12:25:40.788795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7886): Terminating (SIGTERM) 12:25:40.830892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7889): Terminating (SIGTERM) 12:25:40.872910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7892): Terminating (SIGTERM) 12:25:40.915424 --- ParallelTerminationStrategy: PID 7880 died... 12:25:40.935539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7880): Terminated: ok {rc=0} 12:25:40.982828 --- ParallelTerminationStrategy: PID 7881 died... 12:25:41.002469 run iperf3-srv_10.42.42.10(pid=7881): Terminated {rc=256} 12:25:41.049289 --- ParallelTerminationStrategy: PID 7882 died... 12:25:41.068863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7882): Terminated: ok {rc=0} 12:25:41.115872 --- ParallelTerminationStrategy: PID 7883 died... 12:25:41.135441 run iperf3-srv_10.42.42.10(pid=7883): Terminated {rc=256} 12:25:41.182046 --- ParallelTerminationStrategy: PID 7886 died... 12:25:41.201704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7886): Terminated: ok {rc=0} 12:25:41.248168 --- ParallelTerminationStrategy: PID 7889 died... 12:25:41.267787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7889): Terminated: ok {rc=0} 12:25:41.314645 --- ParallelTerminationStrategy: PID 7892 died... 12:25:41.334481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7892): Terminated: ok {rc=0} 12:25:41.422783 bus /gobi_0: Setting Powered False 12:25:42.518816 bus /gobi_0: Setting Powered False 12:25:43.630839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:25:44.779416 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:44.791349 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:25:44.844310 tst iperf3.py: using LAC 28383 12:25:44.971523 tst iperf3.py: using RAC 78 12:25:45.089796 tst iperf3.py: using CellId 28383 12:25:45.206826 tst iperf3.py: using BVCI 28384 12:25:45.317383 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.328268 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.339120 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.349889 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.360194 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.370604 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.381259 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.391691 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:45.402340 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:25:45.518480 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:25:45.738408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:46.063263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7894): Launched 12:25:46.362636 run iperf3-srv_10.42.42.10(pid=7895): Launched 12:25:46.493737 tst iperf3.py:8: start network... 12:25:46.714934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:47.223360 run create_hlr_db(pid=7896): Launched 12:25:47.346811 bus /gobi_6: Setting Powered False 12:25:48.410579 run create_hlr_db(pid=7896): Terminated: ok {rc=0} 12:25:48.839672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7898): Launched 12:25:49.141125 run osmo-hlr_10.42.42.2(pid=7899): Launched 12:25:49.255182 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:49.770157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7901): Launched 12:25:50.069693 run osmo-stp_10.42.42.5(pid=7902): Launched 12:25:50.183446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:50.698428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7904): Launched 12:25:50.812464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:51.064652 run patchelf(pid=7905): Launched 12:25:51.232031 run osmo-stp_10.42.42.5(pid=7902): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7902)] 12:25:51.358736 run osmo-stp_10.42.42.5(pid=7902): stdout: | (launched: 2022-12-10_12:25:50.014925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:51.486491 run osmo-stp_10.42.42.5(pid=7902): stderr: | 20221210122550185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122550185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122550185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122550186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122550186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122550186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122550186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:51.615346 run osmo-stp_10.42.42.5(pid=7902): stdout: | (launched: 2022-12-10_12:25:50.014925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:51.737513 run osmo-stp_10.42.42.5(pid=7902): stderr: | 20221210122550185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122550185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122550185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122550186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122550186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122550186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122550186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:51.882770 run patchelf(pid=7905): Terminating (SIGINT) 12:25:52.051811 run patchelf(pid=7905): Terminated: ok {rc=0} 12:25:52.173124 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7902): Process ended prematurely: osmo-stp_10.42.42.5(pid=7902) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7902)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 12:25:52.182405 tst iperf3.py:8: Test FAILED (7.4 sec) 12:25:52.209350 run osmo-hlr_10.42.42.2(pid=7899): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7899)] 12:25:52.256309 run osmo-hlr_10.42.42.2(pid=7899): stdout: | (launched: 2022-12-10_12:25:49.085801) 12:25:52.304687 run osmo-hlr_10.42.42.2(pid=7899): stderr: | 20221210122549262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122549262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122549262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122549262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122549262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122549262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122549274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122549283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122549283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122549283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:52.353586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7894): Terminating (SIGTERM) 12:25:52.392698 run iperf3-srv_10.42.42.10(pid=7895): Terminating (SIGTERM) 12:25:52.431985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7898): Terminating (SIGTERM) 12:25:52.471181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7901): Terminating (SIGTERM) 12:25:52.510356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7904): Terminating (SIGTERM) 12:25:52.550113 --- ParallelTerminationStrategy: PID 7894 died... 12:25:52.569232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7894): Terminated: ok {rc=0} 12:25:52.613380 --- ParallelTerminationStrategy: PID 7895 died... 12:25:52.632010 run iperf3-srv_10.42.42.10(pid=7895): Terminated {rc=256} 12:25:52.675712 --- ParallelTerminationStrategy: PID 7898 died... 12:25:52.694435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7898): Terminated: ok {rc=0} 12:25:52.738730 --- ParallelTerminationStrategy: PID 7901 died... 12:25:52.757381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7901): Terminated: ok {rc=0} 12:25:52.800862 --- ParallelTerminationStrategy: PID 7904 died... 12:25:52.819907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7904): Terminated: ok {rc=0} 12:25:52.903394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:25:54.052075 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.063964 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:25:54.115197 tst iperf3m4.py: using LAC 28384 12:25:54.235228 tst iperf3m4.py: using RAC 79 12:25:54.354274 tst iperf3m4.py: using CellId 28384 12:25:54.473988 tst iperf3m4.py: using BVCI 28385 12:25:54.584041 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.595043 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.605821 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.616527 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.627284 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.637962 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.648849 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.659522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:25:54.670388 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:25:54.788335 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:25:54.905655 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:25:55.022932 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:25:55.140289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:25:55.342735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:55.643789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7906): Launched 12:25:55.905295 run iperf3-srv_10.42.42.10(pid=7907): Launched 12:25:56.018761 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:25:56.219354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:56.519775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7908): Launched 12:25:56.779840 run iperf3-srv_10.42.42.10(pid=7909): Launched 12:25:56.891972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:25:57.092029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:57.391578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7910): Launched 12:25:57.652404 run iperf3-srv_10.42.42.10(pid=7911): Launched 12:25:57.764690 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:25:57.965162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:58.265556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7912): Launched 12:25:58.526208 run iperf3-srv_10.42.42.10(pid=7913): Launched 12:25:58.638413 tst iperf3m4.py:8: start network... 12:25:58.838248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:59.302295 run create_hlr_db(pid=7914): Launched 12:25:59.424735 bus /gobi_6: Setting Powered False 12:26:00.485355 run create_hlr_db(pid=7914): Terminated: ok {rc=0} 12:26:00.927285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7916): Launched 12:26:01.346040 run osmo-hlr_10.42.42.2(pid=7917): Launched 12:26:01.514105 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:02.285628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7919): Launched 12:26:02.592715 run osmo-stp_10.42.42.5(pid=7920): Launched 12:26:02.707321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:03.222376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7922): Launched 12:26:03.336454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:03.589359 run patchelf(pid=7923): Launched 12:26:03.756573 run osmo-stp_10.42.42.5(pid=7920): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7920)] 12:26:03.883167 run osmo-stp_10.42.42.5(pid=7920): stdout: | (launched: 2022-12-10_12:26:02.537482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:04.011557 run osmo-stp_10.42.42.5(pid=7920): stderr: | 20221210122602708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122602708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122602709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122602709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122602711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122602712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122602712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:04.140705 run osmo-stp_10.42.42.5(pid=7920): stdout: | (launched: 2022-12-10_12:26:02.537482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:04.263802 run osmo-stp_10.42.42.5(pid=7920): stderr: | 20221210122602708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122602708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122602709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122602709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122602711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122602712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122602712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:04.409163 run patchelf(pid=7923): Terminating (SIGINT) 12:26:04.578330 run patchelf(pid=7923): Terminated: ok {rc=0} 12:26:04.699655 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7920): Process ended prematurely: osmo-stp_10.42.42.5(pid=7920) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7920)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 12:26:04.709291 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:26:04.737098 run osmo-hlr_10.42.42.2(pid=7917): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7917)] 12:26:04.785065 run osmo-hlr_10.42.42.2(pid=7917): stdout: | (launched: 2022-12-10_12:26:01.269971) 12:26:04.834472 run osmo-hlr_10.42.42.2(pid=7917): stderr: | 20221210122601639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122601639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122601639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122601639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122601639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122601640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122601661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122601684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122601684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122601684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:04.884257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7906): Terminating (SIGTERM) 12:26:04.923994 run iperf3-srv_10.42.42.10(pid=7907): Terminating (SIGTERM) 12:26:04.963447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7908): Terminating (SIGTERM) 12:26:05.002811 run iperf3-srv_10.42.42.10(pid=7909): Terminating (SIGTERM) 12:26:05.041988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7910): Terminating (SIGTERM) 12:26:05.081357 run iperf3-srv_10.42.42.10(pid=7911): Terminating (SIGTERM) 12:26:05.120521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7912): Terminating (SIGTERM) 12:26:05.159776 run iperf3-srv_10.42.42.10(pid=7913): Terminating (SIGTERM) 12:26:05.198894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7916): Terminating (SIGTERM) 12:26:05.238134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7919): Terminating (SIGTERM) 12:26:05.277486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7922): Terminating (SIGTERM) 12:26:05.317477 --- ParallelTerminationStrategy: PID 7906 died... 12:26:05.336826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7906): Terminated: ok {rc=0} 12:26:05.381718 --- ParallelTerminationStrategy: PID 7907 died... 12:26:05.400402 run iperf3-srv_10.42.42.10(pid=7907): Terminated {rc=256} 12:26:05.444529 --- ParallelTerminationStrategy: PID 7908 died... 12:26:05.463300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7908): Terminated: ok {rc=0} 12:26:05.507368 --- ParallelTerminationStrategy: PID 7909 died... 12:26:05.526250 run iperf3-srv_10.42.42.10(pid=7909): Terminated {rc=256} 12:26:05.569910 --- ParallelTerminationStrategy: PID 7910 died... 12:26:05.588444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7910): Terminated: ok {rc=0} 12:26:05.632361 --- ParallelTerminationStrategy: PID 7911 died... 12:26:05.650993 run iperf3-srv_10.42.42.10(pid=7911): Terminated {rc=256} 12:26:05.694689 --- ParallelTerminationStrategy: PID 7912 died... 12:26:05.713411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7912): Terminated: ok {rc=0} 12:26:05.757533 --- ParallelTerminationStrategy: PID 7913 died... 12:26:05.776285 run iperf3-srv_10.42.42.10(pid=7913): Terminated {rc=256} 12:26:05.819884 --- ParallelTerminationStrategy: PID 7916 died... 12:26:05.838313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7916): Terminated: ok {rc=0} 12:26:05.881960 --- ParallelTerminationStrategy: PID 7919 died... 12:26:05.900516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7919): Terminated: ok {rc=0} 12:26:05.943945 --- ParallelTerminationStrategy: PID 7922 died... 12:26:05.962699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7922): Terminated: ok {rc=0} 12:26:06.045335 bus /gobi_4: Setting Powered False 12:26:07.142372 bus /gobi_4: Setting Powered False 12:26:08.256561 bus /gobi_1: Setting Powered False 12:26:09.357893 bus /gobi_1: Setting Powered False 12:26:10.473948 bus /gobi_0: Setting Powered False 12:26:11.569293 bus /gobi_0: Setting Powered False 12:26:12.684571 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 12:26:13.787749 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:13.799175 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:26:13.847855 tst ping.py: using LAC 28385 12:26:13.965480 tst ping.py: using RAC 80 12:26:14.081429 tst ping.py: using CellId 28385 12:26:14.197404 tst ping.py: using BVCI 28386 12:26:14.304084 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:14.315021 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:14.325850 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:14.336499 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:14.347192 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:14.357781 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:14.368590 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:14.379213 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:26:14.491011 tst ping.py:19: start network... 12:26:14.687060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:15.142030 run create_hlr_db(pid=7924): Launched 12:26:15.262748 bus /gobi_6: Setting Powered False 12:26:16.349610 run create_hlr_db(pid=7924): Terminated: ok {rc=0} 12:26:16.817731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7926): Launched 12:26:17.155987 run osmo-hlr_10.42.42.2(pid=7927): Launched 12:26:17.279089 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:17.840048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7929): Launched 12:26:18.156349 run osmo-stp_10.42.42.5(pid=7930): Launched 12:26:18.278182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:18.825328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7932): Launched 12:26:18.946284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:19.213639 run patchelf(pid=7933): Launched 12:26:19.390022 run osmo-stp_10.42.42.5(pid=7930): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7930)] 12:26:19.523545 run osmo-stp_10.42.42.5(pid=7930): stdout: | (launched: 2022-12-10_12:26:18.098531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:19.658686 run osmo-stp_10.42.42.5(pid=7930): stderr: | 20221210122618288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122618288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122618288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122618289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122618289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122618289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122618289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:19.794506 run osmo-stp_10.42.42.5(pid=7930): stdout: | (launched: 2022-12-10_12:26:18.098531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:19.924077 run osmo-stp_10.42.42.5(pid=7930): stderr: | 20221210122618288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122618288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122618288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122618289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122618289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122618289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122618289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:20.077994 run patchelf(pid=7933): Terminating (SIGINT) 12:26:20.255057 run patchelf(pid=7933): Terminated: ok {rc=0} 12:26:20.382672 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7930): Process ended prematurely: osmo-stp_10.42.42.5(pid=7930) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7930)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 12:26:20.392055 tst ping.py:22: Test FAILED (6.6 sec) 12:26:20.420713 run osmo-hlr_10.42.42.2(pid=7927): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7927)] 12:26:20.471194 run osmo-hlr_10.42.42.2(pid=7927): stdout: | (launched: 2022-12-10_12:26:17.088566) 12:26:20.523186 run osmo-hlr_10.42.42.2(pid=7927): stderr: | 20221210122617331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122617331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122617331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122617331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122617331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122617331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122617343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122617353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122617354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122617354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:20.575759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7926): Terminating (SIGTERM) 12:26:20.617789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7929): Terminating (SIGTERM) 12:26:20.659722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7932): Terminating (SIGTERM) 12:26:20.702106 --- ParallelTerminationStrategy: PID 7926 died... 12:26:20.722172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7926): Terminated: ok {rc=0} 12:26:20.769233 --- ParallelTerminationStrategy: PID 7929 died... 12:26:20.788841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7929): Terminated: ok {rc=0} 12:26:20.835391 --- ParallelTerminationStrategy: PID 7932 died... 12:26:20.854940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7932): Terminated: ok {rc=0} 12:26:20.942366 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:26:22.030650 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.042261 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:26:22.096247 tst ping_idle_ping.py: using LAC 28386 12:26:22.212814 tst ping_idle_ping.py: using RAC 81 12:26:22.327558 tst ping_idle_ping.py: using CellId 28386 12:26:22.442210 tst ping_idle_ping.py: using BVCI 28387 12:26:22.549278 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.560165 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.570837 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.582152 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.593346 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.604468 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.615876 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:26:22.627114 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:26:22.739073 tst ping_idle_ping.py:24: start network... 12:26:22.938061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:23.401086 run create_hlr_db(pid=7934): Launched 12:26:23.522468 bus /gobi_6: Setting Powered False 12:26:24.582355 run create_hlr_db(pid=7934): Terminated: ok {rc=0} 12:26:25.016909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7936): Launched 12:26:25.334033 run osmo-hlr_10.42.42.2(pid=7937): Launched 12:26:25.455554 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:26.004113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7939): Launched 12:26:26.321131 run osmo-stp_10.42.42.5(pid=7940): Launched 12:26:26.442724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:26.993067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7942): Launched 12:26:27.114750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:27.382724 run patchelf(pid=7943): Launched 12:26:27.559303 run osmo-stp_10.42.42.5(pid=7940): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7940)] 12:26:27.693199 run osmo-stp_10.42.42.5(pid=7940): stdout: | (launched: 2022-12-10_12:26:26.263379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:27.829281 run osmo-stp_10.42.42.5(pid=7940): stderr: | 20221210122626457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122626457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122626457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122626458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122626458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122626458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122626458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:27.964544 run osmo-stp_10.42.42.5(pid=7940): stdout: | (launched: 2022-12-10_12:26:26.263379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:28.094488 run osmo-stp_10.42.42.5(pid=7940): stderr: | 20221210122626457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122626457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122626457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122626458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122626458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122626458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122626458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:28.248341 run patchelf(pid=7943): Terminating (SIGINT) 12:26:28.426146 run patchelf(pid=7943): Terminated: ok {rc=0} 12:26:28.553694 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7940): Process ended prematurely: osmo-stp_10.42.42.5(pid=7940) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7940)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:26:28.563065 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:26:28.591938 run osmo-hlr_10.42.42.2(pid=7937): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7937)] 12:26:28.641992 run osmo-hlr_10.42.42.2(pid=7937): stdout: | (launched: 2022-12-10_12:26:25.276095) 12:26:28.693836 run osmo-hlr_10.42.42.2(pid=7937): stderr: | 20221210122625472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122625472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122625472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122625472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122625472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122625472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122625483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122625492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122625492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122625492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:28.746959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7936): Terminating (SIGTERM) 12:26:28.789057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7939): Terminating (SIGTERM) 12:26:28.831061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7942): Terminating (SIGTERM) 12:26:28.873186 --- ParallelTerminationStrategy: PID 7936 died... 12:26:28.893013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7936): Terminated: ok {rc=0} 12:26:28.939339 --- ParallelTerminationStrategy: PID 7939 died... 12:26:28.958734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7939): Terminated: ok {rc=0} 12:26:29.005175 --- ParallelTerminationStrategy: PID 7942 died... 12:26:29.024565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7942): Terminated: ok {rc=0} 12:26:29.111772 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:26:30.416926 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:30.424217 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:26:30.457820 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:26:30.496850 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:26:30.583159 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:26:30.615962 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:26:30.655287 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:26:31.279743 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:26:31.333780 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:31.345752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:26:31.416668 tst cs_paging_gprs_active.py: using LAC 28387 12:26:31.546818 tst cs_paging_gprs_active.py: using RAC 82 12:26:31.674268 tst cs_paging_gprs_active.py: using CellId 28387 12:26:31.800433 tst cs_paging_gprs_active.py: using BVCI 28388 12:26:31.922435 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:31.934368 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:31.946205 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:31.958455 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:31.970497 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:31.982801 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:31.994721 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:32.006750 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:32.019153 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:26:32.143032 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:26:32.265717 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:26:32.483157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:26:32.805655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7947): Launched 12:26:33.084063 run iperf3-srv_10.42.42.10(pid=7948): Launched 12:26:33.204798 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:26:33.421652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:26:33.742354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7949): Launched 12:26:34.021395 run iperf3-srv_10.42.42.10(pid=7950): Launched 12:26:34.141220 tst cs_paging_gprs_active.py:38: start network... 12:26:34.358050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:34.853476 run create_hlr_db(pid=7951): Launched 12:26:34.975209 bus /gobi_6: Setting Powered False 12:26:36.038902 run create_hlr_db(pid=7951): Terminated: ok {rc=0} 12:26:36.484079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7953): Launched 12:26:36.805120 run osmo-hlr_10.42.42.2(pid=7954): Launched 12:26:36.928158 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:37.482638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7956): Launched 12:26:37.804607 run osmo-stp_10.42.42.5(pid=7957): Launched 12:26:37.928602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:38.483370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7959): Launched 12:26:38.606674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:38.878889 run patchelf(pid=7960): Launched 12:26:39.057440 run osmo-stp_10.42.42.5(pid=7957): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7957)] 12:26:39.193540 run osmo-stp_10.42.42.5(pid=7957): stdout: | (launched: 2022-12-10_12:26:37.745911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:39.331438 run osmo-stp_10.42.42.5(pid=7957): stderr: | 20221210122637937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122637937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122637938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122637938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122637938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122637939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122637939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:39.469594 run osmo-stp_10.42.42.5(pid=7957): stdout: | (launched: 2022-12-10_12:26:37.745911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:39.601558 run osmo-stp_10.42.42.5(pid=7957): stderr: | 20221210122637937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122637937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122637938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122637938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122637938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122637939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122637939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:39.758253 run patchelf(pid=7960): Terminating (SIGINT) 12:26:39.938126 run patchelf(pid=7960): Terminated: ok {rc=0} 12:26:40.067585 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7957): Process ended prematurely: osmo-stp_10.42.42.5(pid=7957) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7957)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:26:40.078069 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:26:40.107093 run osmo-hlr_10.42.42.2(pid=7954): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7954)] 12:26:40.156768 run osmo-hlr_10.42.42.2(pid=7954): stdout: | (launched: 2022-12-10_12:26:36.746581) 12:26:40.208174 run osmo-hlr_10.42.42.2(pid=7954): stderr: | 20221210122636946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122636946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122636946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122636946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122636946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122636946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122636958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122636966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122636966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122636966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:40.259957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7947): Terminating (SIGTERM) 12:26:40.301392 run iperf3-srv_10.42.42.10(pid=7948): Terminating (SIGTERM) 12:26:40.342949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7949): Terminating (SIGTERM) 12:26:40.384703 run iperf3-srv_10.42.42.10(pid=7950): Terminating (SIGTERM) 12:26:40.426094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7953): Terminating (SIGTERM) 12:26:40.467549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7956): Terminating (SIGTERM) 12:26:40.508774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7959): Terminating (SIGTERM) 12:26:40.550504 --- ParallelTerminationStrategy: PID 7947 died... 12:26:40.570275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7947): Terminated: ok {rc=0} 12:26:40.616789 --- ParallelTerminationStrategy: PID 7948 died... 12:26:40.636184 run iperf3-srv_10.42.42.10(pid=7948): Terminated {rc=256} 12:26:40.682307 --- ParallelTerminationStrategy: PID 7949 died... 12:26:40.701710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7949): Terminated: ok {rc=0} 12:26:40.748167 --- ParallelTerminationStrategy: PID 7950 died... 12:26:40.767465 run iperf3-srv_10.42.42.10(pid=7950): Terminated {rc=256} 12:26:40.813643 --- ParallelTerminationStrategy: PID 7953 died... 12:26:40.833180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7953): Terminated: ok {rc=0} 12:26:40.879362 --- ParallelTerminationStrategy: PID 7956 died... 12:26:40.898886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7956): Terminated: ok {rc=0} 12:26:40.945217 --- ParallelTerminationStrategy: PID 7959 died... 12:26:40.964477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7959): Terminated: ok {rc=0} 12:26:41.052486 bus /gobi_0: Setting Powered False 12:26:42.152276 bus /gobi_0: Setting Powered False 12:26:43.270445 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:26:44.416558 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:44.428265 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:26:44.496404 tst iperf3.py: using LAC 28388 12:26:44.613300 tst iperf3.py: using RAC 83 12:26:44.729690 tst iperf3.py: using CellId 28388 12:26:44.845593 tst iperf3.py: using BVCI 28389 12:26:44.953312 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:44.964062 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:44.974675 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:44.985346 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:44.995953 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:45.006571 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:45.017233 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:45.027823 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:45.038498 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:26:45.151183 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:26:45.352150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:26:45.651709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7961): Launched 12:26:45.932165 run iperf3-srv_10.42.42.10(pid=7962): Launched 12:26:46.081772 tst iperf3.py:8: start network... 12:26:46.286153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:46.764051 run create_hlr_db(pid=7963): Launched 12:26:46.920578 bus /gobi_6: Setting Powered False 12:26:47.980715 run create_hlr_db(pid=7963): Terminated: ok {rc=0} 12:26:48.397910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7965): Launched 12:26:48.697275 run osmo-hlr_10.42.42.2(pid=7966): Launched 12:26:48.811267 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:49.338860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7968): Launched 12:26:49.636483 run osmo-stp_10.42.42.5(pid=7969): Launched 12:26:49.750096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:50.279803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7971): Launched 12:26:50.394688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:50.647682 run patchelf(pid=7972): Launched 12:26:50.813875 run osmo-stp_10.42.42.5(pid=7969): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7969)] 12:26:50.940110 run osmo-stp_10.42.42.5(pid=7969): stdout: | (launched: 2022-12-10_12:26:49.582010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:51.068028 run osmo-stp_10.42.42.5(pid=7969): stderr: | 20221210122649755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122649756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122649756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122649756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122649757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122649757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122649757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:51.195934 run osmo-stp_10.42.42.5(pid=7969): stdout: | (launched: 2022-12-10_12:26:49.582010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:51.318267 run osmo-stp_10.42.42.5(pid=7969): stderr: | 20221210122649755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122649756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122649756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122649756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122649757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122649757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122649757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:51.463294 run patchelf(pid=7972): Terminating (SIGINT) 12:26:51.632204 run patchelf(pid=7972): Terminated: ok {rc=0} 12:26:51.753408 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7969): Process ended prematurely: osmo-stp_10.42.42.5(pid=7969) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7969)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:26:51.762825 tst iperf3.py:8: Test FAILED (7.4 sec) 12:26:51.789816 run osmo-hlr_10.42.42.2(pid=7966): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7966)] 12:26:51.836552 run osmo-hlr_10.42.42.2(pid=7966): stdout: | (launched: 2022-12-10_12:26:48.642295) 12:26:51.884895 run osmo-hlr_10.42.42.2(pid=7966): stderr: | 20221210122648819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122648819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122648819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122648819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122648819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122648819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122648831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122648840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122648840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122648841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:51.933854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7961): Terminating (SIGTERM) 12:26:51.973185 run iperf3-srv_10.42.42.10(pid=7962): Terminating (SIGTERM) 12:26:52.012217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7965): Terminating (SIGTERM) 12:26:52.051431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7968): Terminating (SIGTERM) 12:26:52.090661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7971): Terminating (SIGTERM) 12:26:52.130528 --- ParallelTerminationStrategy: PID 7961 died... 12:26:52.149639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7961): Terminated: ok {rc=0} 12:26:52.193531 --- ParallelTerminationStrategy: PID 7962 died... 12:26:52.211659 run iperf3-srv_10.42.42.10(pid=7962): Terminated {rc=256} 12:26:52.255267 --- ParallelTerminationStrategy: PID 7965 died... 12:26:52.273757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7965): Terminated: ok {rc=0} 12:26:52.317208 --- ParallelTerminationStrategy: PID 7968 died... 12:26:52.335719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7968): Terminated: ok {rc=0} 12:26:52.379039 --- ParallelTerminationStrategy: PID 7971 died... 12:26:52.397518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7971): Terminated: ok {rc=0} 12:26:52.480336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:26:53.630373 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:53.642557 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:26:53.713259 tst iperf3m4.py: using LAC 28389 12:26:53.840513 tst iperf3m4.py: using RAC 84 12:26:53.969586 tst iperf3m4.py: using CellId 28389 12:26:54.087758 tst iperf3m4.py: using BVCI 28390 12:26:54.196000 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.207386 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.218381 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.229271 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.240040 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.250871 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.261791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.272271 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:26:54.283028 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:26:54.399206 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:26:54.518245 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:26:54.632148 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:26:54.748741 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:26:54.950504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:26:55.251519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7973): Launched 12:26:55.514826 run iperf3-srv_10.42.42.10(pid=7974): Launched 12:26:55.627298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:26:55.828565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:26:56.129242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7975): Launched 12:26:56.390152 run iperf3-srv_10.42.42.10(pid=7976): Launched 12:26:56.503258 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:26:56.703701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:26:57.004751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7977): Launched 12:26:57.267391 run iperf3-srv_10.42.42.10(pid=7978): Launched 12:26:57.379640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:26:57.579692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:26:57.881181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7979): Launched 12:26:58.142402 run iperf3-srv_10.42.42.10(pid=7980): Launched 12:26:58.254674 tst iperf3m4.py:8: start network... 12:26:58.454717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:58.918652 run create_hlr_db(pid=7981): Launched 12:26:59.041039 bus /gobi_6: Setting Powered False 12:27:00.101174 run create_hlr_db(pid=7981): Terminated: ok {rc=0} 12:27:00.541378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7983): Launched 12:27:00.889789 run osmo-hlr_10.42.42.2(pid=7984): Launched 12:27:01.132219 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:01.783576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7986): Launched 12:27:02.102254 run osmo-stp_10.42.42.5(pid=7987): Launched 12:27:02.368446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:27:02.902724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7989): Launched 12:27:03.017250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:27:03.270440 run patchelf(pid=7990): Launched 12:27:03.437432 run osmo-stp_10.42.42.5(pid=7987): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7987)] 12:27:03.564106 run osmo-stp_10.42.42.5(pid=7987): stdout: | (launched: 2022-12-10_12:27:02.039078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:03.692645 run osmo-stp_10.42.42.5(pid=7987): stderr: | 20221210122702274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122702274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122702275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122702275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122702277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122702277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122702278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:03.821717 run osmo-stp_10.42.42.5(pid=7987): stdout: | (launched: 2022-12-10_12:27:02.039078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:03.944208 run osmo-stp_10.42.42.5(pid=7987): stderr: | 20221210122702274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122702274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122702275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122702275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122702277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122702277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122702278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:04.089678 run patchelf(pid=7990): Terminating (SIGINT) 12:27:04.258746 run patchelf(pid=7990): Terminated: ok {rc=0} 12:27:04.380461 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7987): Process ended prematurely: osmo-stp_10.42.42.5(pid=7987) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7987)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:27:04.389981 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:27:04.417217 run osmo-hlr_10.42.42.2(pid=7984): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7984)] 12:27:04.464576 run osmo-hlr_10.42.42.2(pid=7984): stdout: | (launched: 2022-12-10_12:27:00.805318) 12:27:04.513437 run osmo-hlr_10.42.42.2(pid=7984): stderr: | 20221210122701110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122701110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122701110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122701111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122701111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122701111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122701127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122701144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122701144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122701144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:04.563032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7973): Terminating (SIGTERM) 12:27:04.602297 run iperf3-srv_10.42.42.10(pid=7974): Terminating (SIGTERM) 12:27:04.641579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7975): Terminating (SIGTERM) 12:27:04.680779 run iperf3-srv_10.42.42.10(pid=7976): Terminating (SIGTERM) 12:27:04.719779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7977): Terminating (SIGTERM) 12:27:04.758941 run iperf3-srv_10.42.42.10(pid=7978): Terminating (SIGTERM) 12:27:04.797951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7979): Terminating (SIGTERM) 12:27:04.837413 run iperf3-srv_10.42.42.10(pid=7980): Terminating (SIGTERM) 12:27:04.876741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7983): Terminating (SIGTERM) 12:27:04.915807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7986): Terminating (SIGTERM) 12:27:04.955062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7989): Terminating (SIGTERM) 12:27:04.994597 --- ParallelTerminationStrategy: PID 7973 died... 12:27:05.013543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7973): Terminated: ok {rc=0} 12:27:05.057220 --- ParallelTerminationStrategy: PID 7974 died... 12:27:05.075746 run iperf3-srv_10.42.42.10(pid=7974): Terminated {rc=256} 12:27:05.119680 --- ParallelTerminationStrategy: PID 7975 died... 12:27:05.138057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7975): Terminated: ok {rc=0} 12:27:05.181295 --- ParallelTerminationStrategy: PID 7976 died... 12:27:05.199611 run iperf3-srv_10.42.42.10(pid=7976): Terminated {rc=256} 12:27:05.243151 --- ParallelTerminationStrategy: PID 7977 died... 12:27:05.261584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7977): Terminated: ok {rc=0} 12:27:05.305281 --- ParallelTerminationStrategy: PID 7978 died... 12:27:05.323602 run iperf3-srv_10.42.42.10(pid=7978): Terminated {rc=256} 12:27:05.367216 --- ParallelTerminationStrategy: PID 7979 died... 12:27:05.385765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7979): Terminated: ok {rc=0} 12:27:05.429181 --- ParallelTerminationStrategy: PID 7980 died... 12:27:05.447482 run iperf3-srv_10.42.42.10(pid=7980): Terminated {rc=256} 12:27:05.490865 --- ParallelTerminationStrategy: PID 7983 died... 12:27:05.509358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7983): Terminated: ok {rc=0} 12:27:05.553084 --- ParallelTerminationStrategy: PID 7986 died... 12:27:05.571526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7986): Terminated: ok {rc=0} 12:27:05.614976 --- ParallelTerminationStrategy: PID 7989 died... 12:27:05.633504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7989): Terminated: ok {rc=0} 12:27:05.719177 bus /gobi_4: Setting Powered False 12:27:06.819331 bus /gobi_4: Setting Powered False 12:27:07.934732 bus /gobi_1: Setting Powered False 12:27:09.033392 bus /gobi_1: Setting Powered False 12:27:10.147395 bus /gobi_0: Setting Powered False 12:27:11.246206 bus /gobi_0: Setting Powered False 12:27:12.361349 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:27:13.464175 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:13.476627 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:27:13.546233 tst ping.py: using LAC 28390 12:27:13.671941 tst ping.py: using RAC 85 12:27:13.796463 tst ping.py: using CellId 28390 12:27:13.923059 tst ping.py: using BVCI 28391 12:27:14.040006 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:14.051519 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:14.062774 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:14.074275 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:14.085787 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:14.097356 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:14.109210 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:14.120741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:27:14.238192 tst ping.py:19: start network... 12:27:14.451996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:14.944068 run create_hlr_db(pid=7992): Launched 12:27:15.065089 bus /gobi_6: Setting Powered False 12:27:16.144689 run create_hlr_db(pid=7992): Terminated: ok {rc=0} 12:27:16.625447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7994): Launched 12:27:16.952505 run osmo-hlr_10.42.42.2(pid=7995): Launched 12:27:17.201876 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:17.729146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7997): Launched 12:27:18.025483 run osmo-stp_10.42.42.5(pid=7998): Launched 12:27:18.138049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:27:18.649987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8000): Launched 12:27:18.762672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:27:19.011600 run patchelf(pid=8001): Launched 12:27:19.175894 run osmo-stp_10.42.42.5(pid=7998): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7998)] 12:27:19.300480 run osmo-stp_10.42.42.5(pid=7998): stdout: | (launched: 2022-12-10_12:27:17.969925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:19.426325 run osmo-stp_10.42.42.5(pid=7998): stderr: | 20221210122718140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122718140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122718140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122718141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122718141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122718141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122718141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:19.552330 run osmo-stp_10.42.42.5(pid=7998): stdout: | (launched: 2022-12-10_12:27:17.969925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:19.672208 run osmo-stp_10.42.42.5(pid=7998): stderr: | 20221210122718140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122718140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122718140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122718141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122718141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122718141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122718141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:19.814636 run patchelf(pid=8001): Terminating (SIGINT) 12:27:19.979386 run patchelf(pid=8001): Terminated: ok {rc=0} 12:27:20.098155 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7998): Process ended prematurely: osmo-stp_10.42.42.5(pid=7998) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7998)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 12:27:20.106950 tst ping.py:22: Test FAILED (6.6 sec) 12:27:20.133739 run osmo-hlr_10.42.42.2(pid=7995): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7995)] 12:27:20.180520 run osmo-hlr_10.42.42.2(pid=7995): stdout: | (launched: 2022-12-10_12:27:16.881372) 12:27:20.229264 run osmo-hlr_10.42.42.2(pid=7995): stderr: | 20221210122717163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122717163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122717163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122717163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122717163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122717163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122717176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122717184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122717184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122717184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:20.278165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7994): Terminating (SIGTERM) 12:27:20.317139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7997): Terminating (SIGTERM) 12:27:20.356224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8000): Terminating (SIGTERM) 12:27:20.395683 --- ParallelTerminationStrategy: PID 7994 died... 12:27:20.414656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7994): Terminated: ok {rc=0} 12:27:20.458415 --- ParallelTerminationStrategy: PID 7997 died... 12:27:20.476708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7997): Terminated: ok {rc=0} 12:27:20.520586 --- ParallelTerminationStrategy: PID 8000 died... 12:27:20.539192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8000): Terminated: ok {rc=0} 12:27:20.621678 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:27:21.708890 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:21.721604 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:27:21.793333 tst ping_idle_ping.py: using LAC 28391 12:27:21.919377 tst ping_idle_ping.py: using RAC 86 12:27:22.045363 tst ping_idle_ping.py: using CellId 28391 12:27:22.171634 tst ping_idle_ping.py: using BVCI 28392 12:27:22.286943 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:22.298309 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:22.309594 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:22.321513 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:22.333302 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:22.345300 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:22.358579 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:27:22.370724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:27:22.485988 tst ping_idle_ping.py:24: start network... 12:27:22.685998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:23.149831 run create_hlr_db(pid=8002): Launched 12:27:23.271289 bus /gobi_6: Setting Powered False 12:27:24.332006 run create_hlr_db(pid=8002): Terminated: ok {rc=0} 12:27:24.767572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Launched 12:27:25.085965 run osmo-hlr_10.42.42.2(pid=8005): Launched 12:27:25.208573 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:25.756039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Launched 12:27:26.072882 run osmo-stp_10.42.42.5(pid=8008): Launched 12:27:26.195958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:27:26.743073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Launched 12:27:26.864803 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:27:27.132843 run patchelf(pid=8011): Launched 12:27:27.309205 run osmo-stp_10.42.42.5(pid=8008): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] 12:27:27.443799 run osmo-stp_10.42.42.5(pid=8008): stdout: | (launched: 2022-12-10_12:27:26.015118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:27.580122 run osmo-stp_10.42.42.5(pid=8008): stderr: | 20221210122726206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122726206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122726207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122726207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122726207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122726207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122726208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:27.716335 run osmo-stp_10.42.42.5(pid=8008): stdout: | (launched: 2022-12-10_12:27:26.015118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:27.847019 run osmo-stp_10.42.42.5(pid=8008): stderr: | 20221210122726206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122726206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122726207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122726207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122726207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122726207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122726208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:28.001567 run patchelf(pid=8011): Terminating (SIGINT) 12:27:28.179075 run patchelf(pid=8011): Terminated: ok {rc=0} 12:27:28.306953 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8008): Process ended prematurely: osmo-stp_10.42.42.5(pid=8008) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:27:28.316393 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:27:28.345202 run osmo-hlr_10.42.42.2(pid=8005): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8005)] 12:27:28.395198 run osmo-hlr_10.42.42.2(pid=8005): stdout: | (launched: 2022-12-10_12:27:25.027976) 12:27:28.446903 run osmo-hlr_10.42.42.2(pid=8005): stderr: | 20221210122725223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122725224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122725224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122725224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122725224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122725225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122725237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122725247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122725247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122725247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:28.498789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Terminating (SIGTERM) 12:27:28.540390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Terminating (SIGTERM) 12:27:28.582333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Terminating (SIGTERM) 12:27:28.624379 --- ParallelTerminationStrategy: PID 8004 died... 12:27:28.644237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Terminated: ok {rc=0} 12:27:28.690681 --- ParallelTerminationStrategy: PID 8007 died... 12:27:28.710312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Terminated: ok {rc=0} 12:27:28.756723 --- ParallelTerminationStrategy: PID 8010 died... 12:27:28.776539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Terminated: ok {rc=0} 12:27:28.863528 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:27:30.172103 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:30.178931 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:27:30.210196 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 12:27:30.247760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 12:27:30.331844 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:27:30.362779 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 12:27:30.399548 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 12:27:31.033179 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 12:27:31.082005 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.093676 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:27:31.140282 tst cs_paging_gprs_active.py: using LAC 28392 12:27:31.259993 tst cs_paging_gprs_active.py: using RAC 87 12:27:31.381167 tst cs_paging_gprs_active.py: using CellId 28392 12:27:31.508642 tst cs_paging_gprs_active.py: using BVCI 28393 12:27:31.630665 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.643288 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.656879 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.671050 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.683473 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.697596 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.711218 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.723849 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:31.737769 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:27:31.868301 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:27:31.995908 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:27:32.216399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:27:32.537747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8017): Launched 12:27:32.814149 run iperf3-srv_10.42.42.10(pid=8018): Launched 12:27:32.933571 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:27:33.147681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:27:33.466445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8019): Launched 12:27:33.742098 run iperf3-srv_10.42.42.10(pid=8020): Launched 12:27:33.861524 tst cs_paging_gprs_active.py:38: start network... 12:27:34.075568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:34.567677 run create_hlr_db(pid=8021): Launched 12:27:34.688539 bus /gobi_6: Setting Powered False 12:27:35.751303 run create_hlr_db(pid=8021): Terminated: ok {rc=0} 12:27:36.196680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8023): Launched 12:27:36.513498 run osmo-hlr_10.42.42.2(pid=8024): Launched 12:27:36.635118 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:37.183570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8026): Launched 12:27:37.485082 run osmo-stp_10.42.42.5(pid=8027): Launched 12:27:37.599757 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:27:38.112622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8029): Launched 12:27:38.226425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:27:38.476053 run patchelf(pid=8030): Launched 12:27:38.640909 run osmo-stp_10.42.42.5(pid=8027): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8027)] 12:27:38.766785 run osmo-stp_10.42.42.5(pid=8027): stdout: | (launched: 2022-12-10_12:27:37.431217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:38.895058 run osmo-stp_10.42.42.5(pid=8027): stderr: | 20221210122737601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122737601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122737601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122737602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122737602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122737602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122737602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:39.022273 run osmo-stp_10.42.42.5(pid=8027): stdout: | (launched: 2022-12-10_12:27:37.431217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:39.143819 run osmo-stp_10.42.42.5(pid=8027): stderr: | 20221210122737601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122737601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122737601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122737602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122737602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122737602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122737602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:39.287388 run patchelf(pid=8030): Terminating (SIGINT) 12:27:39.454501 run patchelf(pid=8030): Terminated: ok {rc=0} 12:27:39.574988 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8027): Process ended prematurely: osmo-stp_10.42.42.5(pid=8027) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8027)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 12:27:39.584398 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 12:27:39.610992 run osmo-hlr_10.42.42.2(pid=8024): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8024)] 12:27:39.658160 run osmo-hlr_10.42.42.2(pid=8024): stdout: | (launched: 2022-12-10_12:27:36.456169) 12:27:39.706998 run osmo-hlr_10.42.42.2(pid=8024): stderr: | 20221210122736653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122736653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122736653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122736654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122736654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122736654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122736666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122736675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122736675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122736675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:39.756244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8017): Terminating (SIGTERM) 12:27:39.795598 run iperf3-srv_10.42.42.10(pid=8018): Terminating (SIGTERM) 12:27:39.834867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8019): Terminating (SIGTERM) 12:27:39.874223 run iperf3-srv_10.42.42.10(pid=8020): Terminating (SIGTERM) 12:27:39.913397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8023): Terminating (SIGTERM) 12:27:39.955875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8026): Terminating (SIGTERM) 12:27:39.997400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8029): Terminating (SIGTERM) 12:27:40.039150 --- ParallelTerminationStrategy: PID 8017 died... 12:27:40.058787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8017): Terminated: ok {rc=0} 12:27:40.105090 --- ParallelTerminationStrategy: PID 8018 died... 12:27:40.124314 run iperf3-srv_10.42.42.10(pid=8018): Terminated {rc=256} 12:27:40.170830 --- ParallelTerminationStrategy: PID 8019 died... 12:27:40.189977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8019): Terminated: ok {rc=0} 12:27:40.236075 --- ParallelTerminationStrategy: PID 8020 died... 12:27:40.255289 run iperf3-srv_10.42.42.10(pid=8020): Terminated {rc=256} 12:27:40.301132 --- ParallelTerminationStrategy: PID 8023 died... 12:27:40.320350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8023): Terminated: ok {rc=0} 12:27:40.366934 --- ParallelTerminationStrategy: PID 8026 died... 12:27:40.386099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8026): Terminated: ok {rc=0} 12:27:40.432192 --- ParallelTerminationStrategy: PID 8029 died... 12:27:40.451458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8029): Terminated: ok {rc=0} 12:27:40.538323 bus /gobi_0: Setting Powered False 12:27:41.639312 bus /gobi_0: Setting Powered False 12:27:42.754177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 12:27:43.895178 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:43.907107 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:27:43.956273 tst iperf3.py: using LAC 28393 12:27:44.073338 tst iperf3.py: using RAC 88 12:27:44.189384 tst iperf3.py: using CellId 28393 12:27:44.309711 tst iperf3.py: using BVCI 28394 12:27:44.427532 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.439243 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.450780 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.462563 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.474283 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.485982 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.498602 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.510411 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:44.522751 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:27:44.642174 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:27:44.840894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:27:45.138260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8031): Launched 12:27:45.395041 run iperf3-srv_10.42.42.10(pid=8032): Launched 12:27:45.505853 tst iperf3.py:8: start network... 12:27:45.703041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:46.208010 run create_hlr_db(pid=8033): Launched 12:27:46.363922 bus /gobi_6: Setting Powered False 12:27:47.421735 run create_hlr_db(pid=8033): Terminated: ok {rc=0} 12:27:47.875053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8035): Launched 12:27:48.192504 run osmo-hlr_10.42.42.2(pid=8036): Launched 12:27:48.314922 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:48.860227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8038): Launched 12:27:49.177486 run osmo-stp_10.42.42.5(pid=8039): Launched 12:27:49.299190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:27:49.847336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8041): Launched 12:27:49.969325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:27:50.237654 run patchelf(pid=8042): Launched 12:27:50.414354 run osmo-stp_10.42.42.5(pid=8039): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8039)] 12:27:50.549320 run osmo-stp_10.42.42.5(pid=8039): stdout: | (launched: 2022-12-10_12:27:49.119966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:50.685920 run osmo-stp_10.42.42.5(pid=8039): stderr: | 20221210122749313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122749314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122749314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122749314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122749315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122749315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122749315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:50.823177 run osmo-stp_10.42.42.5(pid=8039): stdout: | (launched: 2022-12-10_12:27:49.119966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:50.954387 run osmo-stp_10.42.42.5(pid=8039): stderr: | 20221210122749313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122749314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122749314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122749314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122749315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122749315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122749315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:51.109197 run patchelf(pid=8042): Terminating (SIGINT) 12:27:51.287417 run patchelf(pid=8042): Terminated: ok {rc=0} 12:27:51.415833 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8039): Process ended prematurely: osmo-stp_10.42.42.5(pid=8039) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8039)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 12:27:51.425987 tst iperf3.py:8: Test FAILED (7.6 sec) 12:27:51.454373 run osmo-hlr_10.42.42.2(pid=8036): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8036)] 12:27:51.504586 run osmo-hlr_10.42.42.2(pid=8036): stdout: | (launched: 2022-12-10_12:27:48.135227) 12:27:51.556152 run osmo-hlr_10.42.42.2(pid=8036): stderr: | 20221210122748333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122748333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122748333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122748333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122748333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122748333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122748345 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122748353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122748353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122748353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:51.608109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8031): Terminating (SIGTERM) 12:27:51.649836 run iperf3-srv_10.42.42.10(pid=8032): Terminating (SIGTERM) 12:27:51.691363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8035): Terminating (SIGTERM) 12:27:51.733025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8038): Terminating (SIGTERM) 12:27:51.774547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8041): Terminating (SIGTERM) 12:27:51.816634 --- ParallelTerminationStrategy: PID 8031 died... 12:27:51.836420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8031): Terminated: ok {rc=0} 12:27:51.882431 --- ParallelTerminationStrategy: PID 8032 died... 12:27:51.901962 run iperf3-srv_10.42.42.10(pid=8032): Terminated {rc=256} 12:27:51.948232 --- ParallelTerminationStrategy: PID 8035 died... 12:27:51.967816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8035): Terminated: ok {rc=0} 12:27:52.013846 --- ParallelTerminationStrategy: PID 8038 died... 12:27:52.033096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8038): Terminated: ok {rc=0} 12:27:52.079039 --- ParallelTerminationStrategy: PID 8041 died... 12:27:52.098222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8041): Terminated: ok {rc=0} 12:27:52.185287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 12:27:53.333298 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.348415 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:27:53.399366 tst iperf3m4.py: using LAC 28394 12:27:53.519147 tst iperf3m4.py: using RAC 89 12:27:53.639134 tst iperf3m4.py: using CellId 28394 12:27:53.757824 tst iperf3m4.py: using BVCI 28395 12:27:53.866216 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.877591 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.888819 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.900448 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.911946 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.923405 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.935101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.946578 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:27:53.958291 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:27:54.076609 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:27:54.194285 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:27:54.312381 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:27:54.429539 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:27:54.647008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:27:54.968166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Launched 12:27:55.245123 run iperf3-srv_10.42.42.10(pid=8044): Launched 12:27:55.364579 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:27:55.578969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:27:55.898072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8045): Launched 12:27:56.173459 run iperf3-srv_10.42.42.10(pid=8046): Launched 12:27:56.292039 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:27:56.505965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:27:56.824607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8047): Launched 12:27:57.102259 run iperf3-srv_10.42.42.10(pid=8048): Launched 12:27:57.221227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:27:57.435099 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:27:57.753645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8049): Launched 12:27:58.031049 run iperf3-srv_10.42.42.10(pid=8050): Launched 12:27:58.150064 tst iperf3m4.py:8: start network... 12:27:58.364233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:58.859770 run create_hlr_db(pid=8051): Launched 12:27:58.982046 bus /gobi_6: Setting Powered False 12:28:00.045394 run create_hlr_db(pid=8051): Terminated: ok {rc=0} 12:28:00.488680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8053): Launched 12:28:00.807079 run osmo-hlr_10.42.42.2(pid=8054): Launched 12:28:01.038378 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:01.726112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8056): Launched 12:28:02.061697 run osmo-stp_10.42.42.5(pid=8057): Launched 12:28:02.297783 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:02.888530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8059): Launched 12:28:03.002615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:03.253562 run patchelf(pid=8060): Launched 12:28:03.419463 run osmo-stp_10.42.42.5(pid=8057): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8057)] 12:28:03.545306 run osmo-stp_10.42.42.5(pid=8057): stdout: | (launched: 2022-12-10_12:28:01.989540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:03.672257 run osmo-stp_10.42.42.5(pid=8057): stderr: | 20221210122802326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122802326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122802326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122802327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122802327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122802327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122802327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:03.799579 run osmo-stp_10.42.42.5(pid=8057): stdout: | (launched: 2022-12-10_12:28:01.989540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:03.920566 run osmo-stp_10.42.42.5(pid=8057): stderr: | 20221210122802326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122802326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122802326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122802327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122802327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122802327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122802327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:04.064205 run patchelf(pid=8060): Terminating (SIGINT) 12:28:04.231361 run patchelf(pid=8060): Terminated: ok {rc=0} 12:28:04.351528 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8057): Process ended prematurely: osmo-stp_10.42.42.5(pid=8057) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8057)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:28:04.360996 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:28:04.387822 run osmo-hlr_10.42.42.2(pid=8054): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8054)] 12:28:04.434706 run osmo-hlr_10.42.42.2(pid=8054): stdout: | (launched: 2022-12-10_12:28:00.749250) 12:28:04.483362 run osmo-hlr_10.42.42.2(pid=8054): stderr: | 20221210122801057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122801057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122801057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122801058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122801058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122801058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122801078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122801088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122801094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122801095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:04.533075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Terminating (SIGTERM) 12:28:04.572050 run iperf3-srv_10.42.42.10(pid=8044): Terminating (SIGTERM) 12:28:04.611102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8045): Terminating (SIGTERM) 12:28:04.649784 run iperf3-srv_10.42.42.10(pid=8046): Terminating (SIGTERM) 12:28:04.688481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8047): Terminating (SIGTERM) 12:28:04.727323 run iperf3-srv_10.42.42.10(pid=8048): Terminating (SIGTERM) 12:28:04.766350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8049): Terminating (SIGTERM) 12:28:04.805192 run iperf3-srv_10.42.42.10(pid=8050): Terminating (SIGTERM) 12:28:04.843795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8053): Terminating (SIGTERM) 12:28:04.882746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8056): Terminating (SIGTERM) 12:28:04.921565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8059): Terminating (SIGTERM) 12:28:04.960679 --- ParallelTerminationStrategy: PID 8043 died... 12:28:04.979459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Terminated: ok {rc=0} 12:28:05.023408 --- ParallelTerminationStrategy: PID 8044 died... 12:28:05.041828 run iperf3-srv_10.42.42.10(pid=8044): Terminated {rc=256} 12:28:05.084903 --- ParallelTerminationStrategy: PID 8045 died... 12:28:05.103726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8045): Terminated: ok {rc=0} 12:28:05.147630 --- ParallelTerminationStrategy: PID 8046 died... 12:28:05.166122 run iperf3-srv_10.42.42.10(pid=8046): Terminated {rc=256} 12:28:05.209154 --- ParallelTerminationStrategy: PID 8047 died... 12:28:05.227382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8047): Terminated: ok {rc=0} 12:28:05.270752 --- ParallelTerminationStrategy: PID 8048 died... 12:28:05.289103 run iperf3-srv_10.42.42.10(pid=8048): Terminated {rc=256} 12:28:05.332747 --- ParallelTerminationStrategy: PID 8049 died... 12:28:05.351132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8049): Terminated: ok {rc=0} 12:28:05.394829 --- ParallelTerminationStrategy: PID 8050 died... 12:28:05.413222 run iperf3-srv_10.42.42.10(pid=8050): Terminated {rc=256} 12:28:05.456199 --- ParallelTerminationStrategy: PID 8053 died... 12:28:05.474719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8053): Terminated: ok {rc=0} 12:28:05.517851 --- ParallelTerminationStrategy: PID 8056 died... 12:28:05.536224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8056): Terminated: ok {rc=0} 12:28:05.579479 --- ParallelTerminationStrategy: PID 8059 died... 12:28:05.597945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8059): Terminated: ok {rc=0} 12:28:05.680670 bus /gobi_4: Setting Powered False 12:28:06.777719 bus /gobi_4: Setting Powered False 12:28:07.893393 bus /gobi_1: Setting Powered False 12:28:08.990081 bus /gobi_1: Setting Powered False 12:28:10.104481 bus /gobi_0: Setting Powered False 12:28:11.201814 bus /gobi_0: Setting Powered False 12:28:12.319523 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:28:13.422747 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:13.435096 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:28:13.486543 tst ping.py: using LAC 28395 12:28:13.610565 tst ping.py: using RAC 90 12:28:13.733041 tst ping.py: using CellId 28395 12:28:13.857106 tst ping.py: using BVCI 28396 12:28:13.971131 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:13.982921 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:13.994483 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:14.006304 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:14.017948 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:14.029695 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:14.041472 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:14.053412 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:28:14.168151 tst ping.py:19: start network... 12:28:14.365124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:14.819317 run create_hlr_db(pid=8061): Launched 12:28:14.940065 bus /gobi_6: Setting Powered False 12:28:16.018117 run create_hlr_db(pid=8061): Terminated: ok {rc=0} 12:28:16.529881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8063): Launched 12:28:16.861457 run osmo-hlr_10.42.42.2(pid=8064): Launched 12:28:17.100790 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:17.641146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8066): Launched 12:28:17.932822 run osmo-stp_10.42.42.5(pid=8067): Launched 12:28:18.043942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:18.547110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8069): Launched 12:28:18.658533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:18.903533 run patchelf(pid=8070): Launched 12:28:19.065294 run osmo-stp_10.42.42.5(pid=8067): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8067)] 12:28:19.189666 run osmo-stp_10.42.42.5(pid=8067): stdout: | (launched: 2022-12-10_12:28:17.879369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:19.314940 run osmo-stp_10.42.42.5(pid=8067): stderr: | 20221210122818048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122818048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122818048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122818049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122818049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122818049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122818049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:19.440497 run osmo-stp_10.42.42.5(pid=8067): stdout: | (launched: 2022-12-10_12:28:17.879369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:19.559685 run osmo-stp_10.42.42.5(pid=8067): stderr: | 20221210122818048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122818048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122818048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122818049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122818049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122818049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122818049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:19.701302 run patchelf(pid=8070): Terminating (SIGINT) 12:28:19.864819 run patchelf(pid=8070): Terminated: ok {rc=0} 12:28:19.982477 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8067): Process ended prematurely: osmo-stp_10.42.42.5(pid=8067) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8067)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:28:19.991270 tst ping.py:22: Test FAILED (6.6 sec) 12:28:20.017707 run osmo-hlr_10.42.42.2(pid=8064): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8064)] 12:28:20.064526 run osmo-hlr_10.42.42.2(pid=8064): stdout: | (launched: 2022-12-10_12:28:16.798901) 12:28:20.113128 run osmo-hlr_10.42.42.2(pid=8064): stderr: | 20221210122817105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122817105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122817105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122817106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122817106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122817106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122817160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122817168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122817168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122817168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:20.162231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8063): Terminating (SIGTERM) 12:28:20.201338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8066): Terminating (SIGTERM) 12:28:20.240595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8069): Terminating (SIGTERM) 12:28:20.279989 --- ParallelTerminationStrategy: PID 8063 died... 12:28:20.298848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8063): Terminated: ok {rc=0} 12:28:20.342466 --- ParallelTerminationStrategy: PID 8066 died... 12:28:20.361012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8066): Terminated: ok {rc=0} 12:28:20.404437 --- ParallelTerminationStrategy: PID 8069 died... 12:28:20.423002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8069): Terminated: ok {rc=0} 12:28:20.507965 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:28:21.596465 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:21.608751 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:28:21.658809 tst ping_idle_ping.py: using LAC 28396 12:28:21.775807 tst ping_idle_ping.py: using RAC 91 12:28:21.890359 tst ping_idle_ping.py: using CellId 28396 12:28:22.006194 tst ping_idle_ping.py: using BVCI 28397 12:28:22.111734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:22.122991 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:22.134100 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:22.145147 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:22.156131 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:22.167181 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:22.178274 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:28:22.189360 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:28:22.307355 tst ping_idle_ping.py:24: start network... 12:28:22.521056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:23.011484 run create_hlr_db(pid=8071): Launched 12:28:23.131693 bus /gobi_6: Setting Powered False 12:28:24.193028 run create_hlr_db(pid=8071): Terminated: ok {rc=0} 12:28:24.632412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8073): Launched 12:28:24.947958 run osmo-hlr_10.42.42.2(pid=8074): Launched 12:28:25.070005 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:25.614562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8076): Launched 12:28:25.927923 run osmo-stp_10.42.42.5(pid=8077): Launched 12:28:26.048131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:26.589978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8079): Launched 12:28:26.709333 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:26.974677 run patchelf(pid=8080): Launched 12:28:27.149625 run osmo-stp_10.42.42.5(pid=8077): ERR: Terminated: ERROR {rc=1} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8077)] 12:28:27.283366 run osmo-stp_10.42.42.5(pid=8077): stdout: | (launched: 2022-12-10_12:28:25.871162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:27.418574 run osmo-stp_10.42.42.5(pid=8077): stderr: | 20221210122826063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122826063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122826063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122826064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122826064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122826064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122826064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:27.553816 run osmo-stp_10.42.42.5(pid=8077): stdout: | (launched: 2022-12-10_12:28:25.871162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:27.683253 run osmo-stp_10.42.42.5(pid=8077): stderr: | 20221210122826063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122826063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122826063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122826064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122826064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122826064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122826064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:27.837145 run patchelf(pid=8080): Terminating (SIGINT) 12:28:28.013111 run patchelf(pid=8080): Terminated: ok {rc=0} 12:28:28.139910 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8077): Process ended prematurely: osmo-stp_10.42.42.5(pid=8077) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8077)] [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:28:28.149475 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:28:28.177604 run osmo-hlr_10.42.42.2(pid=8074): ERR: Terminated: ERROR {rc=237} [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8074)] 12:28:28.227455 run osmo-hlr_10.42.42.2(pid=8074): stdout: | (launched: 2022-12-10_12:28:24.890533) 12:28:28.279036 run osmo-hlr_10.42.42.2(pid=8074): stderr: | 20221210122825088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122825088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122825088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122825088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122825088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122825088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122825112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122825121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122825122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122825122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:28.331255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8073): Terminating (SIGTERM) 12:28:28.372789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8076): Terminating (SIGTERM) 12:28:28.414576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8079): Terminating (SIGTERM) 12:28:28.456315 --- ParallelTerminationStrategy: PID 8073 died... 12:28:28.476122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8073): Terminated: ok {rc=0} 12:28:28.522848 --- ParallelTerminationStrategy: PID 8076 died... 12:28:28.542068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8076): Terminated: ok {rc=0} 12:28:28.587998 --- ParallelTerminationStrategy: PID 8079 died... 12:28:28.607270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8079): Terminated: ok {rc=0} 12:28:28.694723 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:28:30.014238 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:30.022778 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:28:30.054796 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:28:30.088308 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:28:30.142907 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:28:30.175860 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:28:30.210859 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:28:30.765779 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2374 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:28:30.771760 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:30.783599 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:28:30.868895 tst switch_tch_pdch.py: using LAC 28397 12:28:30.991420 tst switch_tch_pdch.py: using RAC 92 12:28:31.107968 tst switch_tch_pdch.py: using CellId 28397 12:28:31.234748 tst switch_tch_pdch.py: using BVCI 28398 12:28:31.365818 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:31.378734 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:31.392692 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:31.406596 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:31.420507 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:31.435246 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:31.449149 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:28:31.461815 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:31.585260 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:31.722751 tst switch_tch_pdch.py:51: start network... 12:28:31.922910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:32.382657 run create_hlr_db(pid=8084): Launched 12:28:32.503123 bus /gobi_6: Setting Powered False 12:28:33.561987 run create_hlr_db(pid=8084): Terminated: ok {rc=0} 12:28:33.990694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8086): Launched 12:28:34.303423 run osmo-hlr_10.42.42.2(pid=8087): Launched 12:28:34.423205 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:34.967490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8089): Launched 12:28:35.281241 run osmo-stp_10.42.42.5(pid=8090): Launched 12:28:35.402579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:35.945980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8092): Launched 12:28:36.066972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:36.331876 run patchelf(pid=8093): Launched 12:28:36.507051 run osmo-stp_10.42.42.5(pid=8090): ERR: Terminated: ERROR {rc=1} [trial-2374↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8090)] 12:28:36.639935 run osmo-stp_10.42.42.5(pid=8090): stdout: | (launched: 2022-12-10_12:28:35.223851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:36.774591 run osmo-stp_10.42.42.5(pid=8090): stderr: | 20221210122835414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122835414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122835415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122835415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122835415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122835416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122835416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:36.909827 run osmo-stp_10.42.42.5(pid=8090): stdout: | (launched: 2022-12-10_12:28:35.223851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:37.038658 run osmo-stp_10.42.42.5(pid=8090): stderr: | 20221210122835414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122835414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122835415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122835415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122835415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122835416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122835416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:37.191704 run patchelf(pid=8093): Terminating (SIGINT) 12:28:37.367510 run patchelf(pid=8093): Terminated: ok {rc=0} 12:28:37.494129 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8090): Process ended prematurely: osmo-stp_10.42.42.5(pid=8090) [trial-2374↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8090)] [trial-2374↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:28:37.503608 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:28:37.531858 run osmo-hlr_10.42.42.2(pid=8087): ERR: Terminated: ERROR {rc=237} [trial-2374↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8087)] 12:28:37.582086 run osmo-hlr_10.42.42.2(pid=8087): stdout: | (launched: 2022-12-10_12:28:34.246786) 12:28:37.634173 run osmo-hlr_10.42.42.2(pid=8087): stderr: | 20221210122834445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122834445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122834446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122834446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122834446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122834446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122834459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122834470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122834470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122834470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:37.686639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8086): Terminating (SIGTERM) 12:28:37.728772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8089): Terminating (SIGTERM) 12:28:37.770830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8092): Terminating (SIGTERM) 12:28:37.813455 --- ParallelTerminationStrategy: PID 8086 died... 12:28:37.833191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8086): Terminated: ok {rc=0} 12:28:37.880006 --- ParallelTerminationStrategy: PID 8089 died... 12:28:37.899470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8089): Terminated: ok {rc=0} 12:28:37.945822 --- ParallelTerminationStrategy: PID 8092 died... 12:28:37.965315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8092): Terminated: ok {rc=0} 12:28:38.052240 bus /gobi_0: Setting Powered False 12:28:39.151203 bus /gobi_0: Setting Powered False 12:28:40.268243 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2374 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 nitb_smpp --------------------------------------------------------------------- 12:28:41.517408 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:41.519834 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 12:28:41.539943 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 12:28:41.546806 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 12:28:41.580026 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 12:28:41.600215 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 12:28:41.606738 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 12:28:42.126842 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2374 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:28:42.133440 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:28:42.151888 tst esme_connect_policy_acceptall.py: using MSISDN 7730 12:28:42.293160 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:28:42.889702 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8097): Launched 12:28:43.208809 run osmo-nitb_10.42.42.2(pid=8098): Launched 12:28:43.386512 run osmo-nitb_10.42.42.2(pid=8098): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8098)] 12:28:43.529529 run osmo-nitb_10.42.42.2(pid=8098): stdout: | (launched: 2022-12-10_12:28:43.151364) 12:28:43.673955 run osmo-nitb_10.42.42.2(pid=8098): stderr: | (launched: 2022-12-10_12:28:43.198638) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:43.818734 run osmo-nitb_10.42.42.2(pid=8098): stdout: | (launched: 2022-12-10_12:28:43.151364) 12:28:43.957988 run osmo-nitb_10.42.42.2(pid=8098): stderr: | (launched: 2022-12-10_12:28:43.198638) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8098): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8098) [trial-2374↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8098)] 12:28:44.330585 tst osmo-nitb_10.42.42.2(pid=8098): stdout: | (launched: 2022-12-10_12:28:43.151364) 12:28:44.460512 tst osmo-nitb_10.42.42.2(pid=8098): stderr: | (launched: 2022-12-10_12:28:43.198638) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:44.613153 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=8098): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8098) [trial-2374↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8098)] [trial-2374↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 12:28:44.621954 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 12:28:44.628775 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8097): Terminating (SIGTERM) 12:28:44.840125 --- ParallelTerminationStrategy: PID 8097 died... 12:28:44.863103 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8097): Terminated: ok {rc=0} ---------------------------------------------- trial-2374 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 12:28:44.914286 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:28:44.935123 tst esme_connect_policy_closed.py: using MSISDN 7731 12:28:45.064478 tst esme_connect_policy_closed.py: using MSISDN 7732 12:28:45.173884 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:28:45.730331 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8099): Launched 12:28:46.062690 run osmo-nitb_10.42.42.2(pid=8100): Launched 12:28:46.251168 run osmo-nitb_10.42.42.2(pid=8100): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8100)] 12:28:46.387757 run osmo-nitb_10.42.42.2(pid=8100): stdout: | (launched: 2022-12-10_12:28:45.997562) 12:28:46.527827 run osmo-nitb_10.42.42.2(pid=8100): stderr: | (launched: 2022-12-10_12:28:46.048619) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:46.666604 run osmo-nitb_10.42.42.2(pid=8100): stdout: | (launched: 2022-12-10_12:28:45.997562) 12:28:46.798847 run osmo-nitb_10.42.42.2(pid=8100): stderr: | (launched: 2022-12-10_12:28:46.048619) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:46.957745 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=8100): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8100) [trial-2374↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8100)] [trial-2374↪nitb_smpp↪esme_connect_policy_closed.py:24] 12:28:46.967598 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 12:28:46.975493 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8099): Terminating (SIGTERM) 12:28:47.190228 --- ParallelTerminationStrategy: PID 8099 died... 12:28:47.211248 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8099): Terminated: ok {rc=0} ---------------------------------------------- trial-2374 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:28:47.259882 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:28:47.271008 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:28:47.306597 tst esme_ms_sms_storeforward.py: using LAC 28398 12:28:47.431304 tst esme_ms_sms_storeforward.py: using RAC 93 12:28:47.556330 tst esme_ms_sms_storeforward.py: using CellId 28398 12:28:47.682992 tst esme_ms_sms_storeforward.py: using BVCI 28399 12:28:47.801531 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:28:47.926178 tst esme_ms_sms_storeforward.py: using MSISDN 7733 12:28:48.037514 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 12:28:48.239505 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:28:48.852912 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8101): Launched 12:28:49.153448 run osmo-nitb_10.42.42.2(pid=8102): Launched 12:28:49.315367 run osmo-nitb_10.42.42.2(pid=8102): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8102)] 12:28:49.439779 run osmo-nitb_10.42.42.2(pid=8102): stdout: | (launched: 2022-12-10_12:28:49.098877) 12:28:49.564173 run osmo-nitb_10.42.42.2(pid=8102): stderr: | (launched: 2022-12-10_12:28:49.143350) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:49.688683 run osmo-nitb_10.42.42.2(pid=8102): stdout: | (launched: 2022-12-10_12:28:49.098877) 12:28:49.808071 run osmo-nitb_10.42.42.2(pid=8102): stderr: | (launched: 2022-12-10_12:28:49.143350) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:49.951156 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=8102): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8102) [trial-2374↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8102)] [trial-2374↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 12:28:49.959542 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 12:28:49.966107 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8101): Terminating (SIGTERM) 12:28:50.174557 --- ParallelTerminationStrategy: PID 8101 died... 12:28:50.195158 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8101): Terminated: ok {rc=0} 12:28:50.280437 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:28:51.370470 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:28:51.383288 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:28:51.423807 tst esme_ms_sms_transaction.py: using LAC 28399 12:28:51.554730 tst esme_ms_sms_transaction.py: using RAC 94 12:28:51.680173 tst esme_ms_sms_transaction.py: using CellId 28399 12:28:51.803973 tst esme_ms_sms_transaction.py: using BVCI 28400 12:28:51.921430 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:28:52.052407 tst esme_ms_sms_transaction.py: using MSISDN 7734 12:28:52.170601 tst esme_ms_sms_transaction.py:18: start nitb and bts... 12:28:52.388181 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:28:53.042679 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8104): Launched 12:28:53.364181 run osmo-nitb_10.42.42.2(pid=8105): Launched 12:28:53.542735 run osmo-nitb_10.42.42.2(pid=8105): ERR: Terminated: ERROR {rc=2} [trial-2374↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8105)] 12:28:53.686829 run osmo-nitb_10.42.42.2(pid=8105): stdout: | (launched: 2022-12-10_12:28:53.306101) 12:28:53.832663 run osmo-nitb_10.42.42.2(pid=8105): stderr: | (launched: 2022-12-10_12:28:53.354077) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:53.978168 run osmo-nitb_10.42.42.2(pid=8105): stdout: | (launched: 2022-12-10_12:28:53.306101) 12:28:54.118223 run osmo-nitb_10.42.42.2(pid=8105): stderr: | (launched: 2022-12-10_12:28:53.354077) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f281c19d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8105): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8105) [trial-2374↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8105)] 12:28:54.486648 tst osmo-nitb_10.42.42.2(pid=8105): stdout: | (launched: 2022-12-10_12:28:53.306101) 12:28:54.609715 tst osmo-nitb_10.42.42.2(pid=8105): stderr: | (launched: 2022-12-10_12:28:53.354077) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:28:54.753083 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=8105): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8105) [trial-2374↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8105)] [trial-2374↪nitb_smpp↪esme_ms_sms_transaction.py:21] 12:28:54.761360 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 12:28:54.767753 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8104): Terminating (SIGTERM) 12:28:54.976046 --- ParallelTerminationStrategy: PID 8104 died... 12:28:54.996460 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8104): Terminated: ok {rc=0} 12:28:55.081897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 smpp --------------------------------------------------------------------- 12:28:56.248813 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:56.251524 tst smpp: Verifying 1 x bts (candidates: 11) 12:28:56.271730 tst smpp: Verifying 6 x ip_address (candidates: 9) 12:28:56.298109 tst smpp: Verifying 1 x modem (candidates: 12) 12:28:56.333253 tst smpp: Reserving 1 x bts (candidates: 11) 12:28:56.353998 tst smpp: Reserving 6 x ip_address (candidates: 9) 12:28:56.380758 tst smpp: Reserving 1 x modem (candidates: 12) 12:28:56.905768 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:28:56.910864 tst smpp: Using 1 x ip_address (candidates: 6) 12:28:56.921450 tst smpp: Using 1 x ip_address (candidates: 6) 12:28:56.931564 tst smpp: Using 1 x ip_address (candidates: 6) 12:28:56.941869 tst smpp: Using 1 x ip_address (candidates: 6) 12:28:56.960817 tst esme_connect_policy_acceptall.py: using MSISDN 7735 12:28:57.071737 run osmo-stp_10.42.42.4: Starting osmo-stp 12:28:57.583372 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8109): Launched 12:28:57.882251 run osmo-stp_10.42.42.4(pid=8110): Launched 12:28:57.996682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:58.460327 run create_hlr_db(pid=8111): Launched 12:28:58.582573 bus /sierra_2: Setting Powered False 12:28:59.642222 run create_hlr_db(pid=8111): Terminated: ok {rc=0} 12:29:00.058451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Launched 12:29:00.356278 run osmo-hlr_10.42.42.2(pid=8114): Launched 12:29:00.470875 run osmo-msc_10.42.42.5: Starting osmo-msc 12:29:01.030724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Launched 12:29:01.391436 run osmo-msc_10.42.42.5(pid=8117): Launched 12:29:01.896370 run osmo-hlr_10.42.42.2(pid=8114): ERR: Terminated: ERROR {rc=237} [trial-2374↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8114)] 12:29:02.159041 run osmo-hlr_10.42.42.2(pid=8114): stdout: | (launched: 2022-12-10_12:29:00.301822) 12:29:02.298397 run osmo-hlr_10.42.42.2(pid=8114): stderr: | 20221210122900476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122900476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122900488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122900499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122900500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122900500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:02.435821 run osmo-hlr_10.42.42.2(pid=8114): stdout: | (launched: 2022-12-10_12:29:00.301822) 12:29:02.565123 run osmo-hlr_10.42.42.2(pid=8114): stderr: | 20221210122900476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122900476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122900476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122900488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122900499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122900500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122900500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:02.719226 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=8114): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8114) [trial-2374↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8114)] [trial-2374↪smpp↪esme_connect_policy_acceptall.py:23] 12:29:02.728177 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.8 sec) 12:29:02.756131 run osmo-msc_10.42.42.5(pid=8117): ERR: Terminated: ERROR {rc=9} [trial-2374↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=8117)] 12:29:02.806416 run osmo-msc_10.42.42.5(pid=8117): stdout: | (launched: 2022-12-10_12:29:01.331810) 12:29:02.858701 run osmo-msc_10.42.42.5(pid=8117): stderr: | 20221210122901921 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210122901921 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210122901922 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122901922 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210122901922 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210122901922 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210122901922 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210122901922 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210122901922 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:29:02.911506 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8109): Terminating (SIGTERM) 12:29:02.953448 run osmo-stp_10.42.42.4(pid=8110): Terminating (SIGTERM) 12:29:02.995500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Terminating (SIGTERM) 12:29:03.039575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Terminating (SIGTERM) 12:29:03.085548 --- ParallelTerminationStrategy: PID 8109 died... 12:29:03.106019 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8109): Terminated: ok {rc=0} 12:29:03.155939 --- ParallelTerminationStrategy: PID 8110 died... 12:29:03.175521 run osmo-stp_10.42.42.4(pid=8110): Terminated: ok {rc=0} 12:29:03.222327 --- ParallelTerminationStrategy: PID 8113 died... 12:29:03.241950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Terminated: ok {rc=0} 12:29:03.288765 --- ParallelTerminationStrategy: PID 8116 died... 12:29:03.308438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Terminated: ok {rc=0} ---------------------------------------------- trial-2374 smpp esme_connect_policy_closed.py ---------------------------------------------- 12:29:03.360403 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:03.371724 tst smpp: Using 1 x bts (candidates: 1) 12:29:03.408681 tst esme_connect_policy_closed.py: using LAC 28400 12:29:03.535190 tst esme_connect_policy_closed.py: using RAC 95 12:29:03.660693 tst esme_connect_policy_closed.py: using CellId 28400 12:29:03.786240 tst esme_connect_policy_closed.py: using BVCI 28401 12:29:03.904915 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:03.915615 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:03.926241 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:03.946643 tst esme_connect_policy_closed.py: using MSISDN 7736 12:29:04.072697 tst esme_connect_policy_closed.py: using MSISDN 7737 12:29:04.188459 run osmo-stp_10.42.42.4: Starting osmo-stp 12:29:04.734968 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8120): Launched 12:29:05.057426 run osmo-stp_10.42.42.4(pid=8121): Launched 12:29:05.181236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:05.681312 run create_hlr_db(pid=8122): Launched 12:29:06.861857 run create_hlr_db(pid=8122): Terminated: ok {rc=0} 12:29:07.199658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8124): Launched 12:29:07.522584 run osmo-hlr_10.42.42.2(pid=8125): Launched 12:29:07.646289 run osmo-msc_10.42.42.5: Starting osmo-msc 12:29:08.234152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8127): Launched 12:29:08.557146 run osmo-msc_10.42.42.5(pid=8128): Launched 12:29:08.738337 run osmo-hlr_10.42.42.2(pid=8125): ERR: Terminated: ERROR {rc=237} [trial-2374↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8125)] 12:29:08.875017 run osmo-hlr_10.42.42.2(pid=8125): stdout: | (launched: 2022-12-10_12:29:07.463561) 12:29:09.009300 run osmo-hlr_10.42.42.2(pid=8125): stderr: | 20221210122907661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122907661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122907674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122907682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122907682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122907682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:09.143802 run osmo-hlr_10.42.42.2(pid=8125): stdout: | (launched: 2022-12-10_12:29:07.463561) 12:29:09.272595 run osmo-hlr_10.42.42.2(pid=8125): stderr: | 20221210122907661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122907661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122907661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122907674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122907682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122907682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122907682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:09.427072 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=8125): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8125) [trial-2374↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8125)] [trial-2374↪smpp↪esme_connect_policy_closed.py:31] 12:29:09.436000 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 12:29:09.464031 run osmo-msc_10.42.42.5(pid=8128): ERR: Terminated: ERROR {rc=9} [trial-2374↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=8128)] 12:29:09.514901 run osmo-msc_10.42.42.5(pid=8128): stdout: | (launched: 2022-12-10_12:29:08.498636) 12:29:09.567578 run osmo-msc_10.42.42.5(pid=8128): stderr: | 20221210122908865 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210122908865 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210122908865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122908865 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210122908865 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210122908865 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210122908865 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210122908866 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210122908866 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:29:09.620003 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8120): Terminating (SIGTERM) 12:29:09.662267 run osmo-stp_10.42.42.4(pid=8121): Terminating (SIGTERM) 12:29:09.704330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8124): Terminating (SIGTERM) 12:29:09.747282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8127): Terminating (SIGTERM) 12:29:09.790551 --- ParallelTerminationStrategy: PID 8120 died... 12:29:09.810796 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8120): Terminated: ok {rc=0} 12:29:09.859435 --- ParallelTerminationStrategy: PID 8121 died... 12:29:09.879240 run osmo-stp_10.42.42.4(pid=8121): Terminated: ok {rc=0} 12:29:09.925828 --- ParallelTerminationStrategy: PID 8124 died... 12:29:09.945379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8124): Terminated: ok {rc=0} 12:29:09.991623 --- ParallelTerminationStrategy: PID 8127 died... 12:29:10.011425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8127): Terminated: ok {rc=0} ---------------------------------------------- trial-2374 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:29:10.063311 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:10.074804 tst smpp: Using 1 x bts (candidates: 1) 12:29:10.111166 tst esme_ms_sms_storeforward.py: using LAC 28401 12:29:10.231830 tst esme_ms_sms_storeforward.py: using RAC 96 12:29:10.351864 tst esme_ms_sms_storeforward.py: using CellId 28401 12:29:10.472843 tst esme_ms_sms_storeforward.py: using BVCI 28402 12:29:10.583569 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:10.593817 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:10.603906 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:10.614532 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:10.625073 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:10.635906 tst smpp: Using 1 x modem (candidates: 1) 12:29:10.763541 tst esme_ms_sms_storeforward.py: using MSISDN 7738 12:29:10.882210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:11.381398 run create_hlr_db(pid=8131): Launched 12:29:12.562161 run create_hlr_db(pid=8131): Terminated: ok {rc=0} 12:29:12.901215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8133): Launched 12:29:13.223236 run osmo-hlr_10.42.42.2(pid=8134): Launched 12:29:13.347606 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:13.874254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8136): Launched 12:29:14.175736 run osmo-stp_10.42.42.5(pid=8137): Launched 12:29:14.290626 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:14.833726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8139): Launched 12:29:15.133941 run osmo-msc_10.42.42.6(pid=8140): Launched 12:29:15.303073 run osmo-stp_10.42.42.5(pid=8137): ERR: Terminated: ERROR {rc=1} [trial-2374↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8137)] 12:29:15.430748 run osmo-stp_10.42.42.5(pid=8137): stdout: | (launched: 2022-12-10_12:29:14.121081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:15.557902 run osmo-stp_10.42.42.5(pid=8137): stderr: | 20221210122914292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122914292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122914292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122914293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122914293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122914293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122914293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:15.683749 run osmo-stp_10.42.42.5(pid=8137): stdout: | (launched: 2022-12-10_12:29:14.121081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:15.804199 run osmo-stp_10.42.42.5(pid=8137): stderr: | 20221210122914292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122914292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122914292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122914293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122914293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122914293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122914293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:15.975815 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=8137): Process ended prematurely: osmo-stp_10.42.42.5(pid=8137) [trial-2374↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8137)] [trial-2374↪smpp↪esme_ms_sms_storeforward.py:30] 12:29:15.984563 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 12:29:16.011370 run osmo-hlr_10.42.42.2(pid=8134): ERR: Terminated: ERROR {rc=237} [trial-2374↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8134)] 12:29:16.070947 run osmo-hlr_10.42.42.2(pid=8134): stdout: | (launched: 2022-12-10_12:29:13.165077) 12:29:16.131736 run osmo-hlr_10.42.42.2(pid=8134): stderr: | 20221210122913365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122913365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122913365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122913365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122913365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122913365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122913377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122913385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122913386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122913386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:16.217306 run osmo-msc_10.42.42.6(pid=8140): ERR: Terminated: ERROR {rc=2} [trial-2374↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8140)] 12:29:16.276717 run osmo-msc_10.42.42.6(pid=8140): stdout: | (launched: 2022-12-10_12:29:15.079016) 12:29:16.338476 run osmo-msc_10.42.42.6(pid=8140): stderr: | 20221210122915348 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122915348 DLGLOBAL DEBUG validating counter group 0x7f6f742f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122915348 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122915348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122915348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122915349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122915351 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122915351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122915351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122915351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:16.398257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8133): Terminating (SIGTERM) 12:29:16.444781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8136): Terminating (SIGTERM) 12:29:16.491348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8139): Terminating (SIGTERM) 12:29:16.539189 --- ParallelTerminationStrategy: PID 8133 died... 12:29:16.560450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8133): Terminated: ok {rc=0} 12:29:16.611886 --- ParallelTerminationStrategy: PID 8136 died... 12:29:16.633416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8136): Terminated: ok {rc=0} 12:29:16.683491 --- ParallelTerminationStrategy: PID 8139 died... 12:29:16.704495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8139): Terminated: ok {rc=0} 12:29:16.796588 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:29:17.886010 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:17.896818 tst smpp: Using 1 x bts (candidates: 1) 12:29:17.932734 tst esme_ms_sms_transaction.py: using LAC 28402 12:29:18.053315 tst esme_ms_sms_transaction.py: using RAC 97 12:29:18.180484 tst esme_ms_sms_transaction.py: using CellId 28402 12:29:18.299480 tst esme_ms_sms_transaction.py: using BVCI 28403 12:29:18.407565 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:18.418020 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:18.428273 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:18.438835 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:18.449420 tst smpp: Using 1 x ip_address (candidates: 6) 12:29:18.459775 tst smpp: Using 1 x modem (candidates: 1) 12:29:18.588425 tst esme_ms_sms_transaction.py: using MSISDN 7739 12:29:18.698314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:19.163512 run create_hlr_db(pid=8142): Launched 12:29:19.286732 bus /sierra_2: Setting Powered False 12:29:20.346717 run create_hlr_db(pid=8142): Terminated: ok {rc=0} 12:29:20.765302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8144): Launched 12:29:21.065742 run osmo-hlr_10.42.42.2(pid=8145): Launched 12:29:21.181190 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:21.710880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8147): Launched 12:29:22.010843 run osmo-stp_10.42.42.5(pid=8148): Launched 12:29:22.125320 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:22.666014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8150): Launched 12:29:22.966978 run osmo-msc_10.42.42.6(pid=8151): Launched 12:29:23.136796 run osmo-stp_10.42.42.5(pid=8148): ERR: Terminated: ERROR {rc=1} [trial-2374↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8148)] 12:29:23.264064 run osmo-stp_10.42.42.5(pid=8148): stdout: | (launched: 2022-12-10_12:29:21.956055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:23.391562 run osmo-stp_10.42.42.5(pid=8148): stderr: | 20221210122922124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122922124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122922124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122922125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122922127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122922127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122922127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:23.517211 run osmo-stp_10.42.42.5(pid=8148): stdout: | (launched: 2022-12-10_12:29:21.956055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:23.638657 run osmo-stp_10.42.42.5(pid=8148): stderr: | 20221210122922124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122922124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122922124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122922125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122922127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122922127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122922127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:23.783316 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=8148): Process ended prematurely: osmo-stp_10.42.42.5(pid=8148) [trial-2374↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8148)] [trial-2374↪smpp↪esme_ms_sms_transaction.py:28] 12:29:23.791816 tst esme_ms_sms_transaction.py:28: Test FAILED (5.9 sec) 12:29:23.818103 run osmo-hlr_10.42.42.2(pid=8145): ERR: Terminated: ERROR {rc=237} [trial-2374↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8145)] 12:29:23.866087 run osmo-hlr_10.42.42.2(pid=8145): stdout: | (launched: 2022-12-10_12:29:21.011226) 12:29:23.916100 run osmo-hlr_10.42.42.2(pid=8145): stderr: | 20221210122921185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122921185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122921185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122921185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122921185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122921185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122921197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122921205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122921206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122921206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:23.985379 run osmo-msc_10.42.42.6(pid=8151): ERR: Terminated: ERROR {rc=2} [trial-2374↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8151)] 12:29:24.033246 run osmo-msc_10.42.42.6(pid=8151): stdout: | (launched: 2022-12-10_12:29:22.911989) 12:29:24.082363 run osmo-msc_10.42.42.6(pid=8151): stderr: | 20221210122923184 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122923184 DLGLOBAL DEBUG validating counter group 0x7f38729c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122923184 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122923184 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122923184 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122923185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122923187 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122923188 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122923188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122923188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:24.132041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8144): Terminating (SIGTERM) 12:29:24.171697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8147): Terminating (SIGTERM) 12:29:24.211399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8150): Terminating (SIGTERM) 12:29:24.251605 --- ParallelTerminationStrategy: PID 8144 died... 12:29:24.270725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8144): Terminated: ok {rc=0} 12:29:24.314917 --- ParallelTerminationStrategy: PID 8147 died... 12:29:24.333514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8147): Terminated: ok {rc=0} 12:29:24.377593 --- ParallelTerminationStrategy: PID 8150 died... 12:29:24.396247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8150): Terminated: ok {rc=0} 12:29:24.483128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 encryption --------------------------------------------------------------------- 12:29:25.677465 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:29:25.680266 tst encryption: Verifying 1 x bts (candidates: 11) 12:29:25.700678 tst encryption: Verifying 6 x ip_address (candidates: 9) 12:29:25.728011 tst encryption: Verifying 1 x modem (candidates: 12) 12:29:25.763205 tst encryption: Reserving 1 x bts (candidates: 11) 12:29:25.783811 tst encryption: Reserving 6 x ip_address (candidates: 9) 12:29:25.810887 tst encryption: Reserving 1 x modem (candidates: 12) 12:29:26.339304 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2374 encryption register_a5_0_authopt.py ---------------------------------------------- 12:29:26.391420 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:26.401966 tst encryption: Using 1 x bts (candidates: 1) 12:29:26.437485 tst register_a5_0_authopt.py: using LAC 28403 12:29:26.557388 tst register_a5_0_authopt.py: using RAC 98 12:29:26.676541 tst register_a5_0_authopt.py: using CellId 28403 12:29:26.795407 tst register_a5_0_authopt.py: using BVCI 28404 12:29:26.906561 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:26.916769 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:26.926918 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:26.936933 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:26.947047 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:26.957164 tst encryption: Using 1 x modem (candidates: 1) 12:29:27.073673 tst register_a5_0_authopt.py:8: start network... 12:29:27.295035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:27.801749 run create_hlr_db(pid=8156): Launched 12:29:27.927792 bus /sierra_2: Setting Powered False 12:29:28.992910 run create_hlr_db(pid=8156): Terminated: ok {rc=0} 12:29:29.429909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8158): Launched 12:29:29.734468 run osmo-hlr_10.42.42.2(pid=8159): Launched 12:29:29.850651 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:30.387397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8161): Launched 12:29:30.689652 run osmo-stp_10.42.42.5(pid=8162): Launched 12:29:30.805284 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:31.470827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8164): Launched 12:29:31.828125 run osmo-msc_10.42.42.6(pid=8165): Launched 12:29:32.120164 run osmo-stp_10.42.42.5(pid=8162): ERR: Terminated: ERROR {rc=1} [trial-2374↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8162)] 12:29:32.335712 run osmo-stp_10.42.42.5(pid=8162): stdout: | (launched: 2022-12-10_12:29:30.634682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:32.477143 run osmo-stp_10.42.42.5(pid=8162): stderr: | 20221210122930805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122930805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122930805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122930806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122930806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122930806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122930806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:32.613287 run osmo-stp_10.42.42.5(pid=8162): stdout: | (launched: 2022-12-10_12:29:30.634682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:32.744056 run osmo-stp_10.42.42.5(pid=8162): stderr: | 20221210122930805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122930805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122930805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122930806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122930806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122930806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122930806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:32.900489 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8162): Process ended prematurely: osmo-stp_10.42.42.5(pid=8162) [trial-2374↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8162)] [trial-2374↪encryption↪register_a5_0_authopt.py:8] 12:29:32.910287 tst register_a5_0_authopt.py:8: Test FAILED (6.6 sec) 12:29:32.938764 run osmo-hlr_10.42.42.2(pid=8159): ERR: Terminated: ERROR {rc=237} [trial-2374↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8159)] 12:29:32.989165 run osmo-hlr_10.42.42.2(pid=8159): stdout: | (launched: 2022-12-10_12:29:29.679135) 12:29:33.041171 run osmo-hlr_10.42.42.2(pid=8159): stderr: | 20221210122929855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122929855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122929855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122929855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122929855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122929855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122929866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122929874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122929875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122929875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:33.113378 run osmo-msc_10.42.42.6(pid=8165): ERR: Terminated: ERROR {rc=2} [trial-2374↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8165)] 12:29:33.163613 run osmo-msc_10.42.42.6(pid=8165): stdout: | (launched: 2022-12-10_12:29:31.757917) 12:29:33.215405 run osmo-msc_10.42.42.6(pid=8165): stderr: | 20221210122932306 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122932306 DLGLOBAL DEBUG validating counter group 0x7f2ec727cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122932306 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122932306 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122932306 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122932307 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122932310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122932311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122932311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122932311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:33.268063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8158): Terminating (SIGTERM) 12:29:33.310203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8161): Terminating (SIGTERM) 12:29:33.352497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8164): Terminating (SIGTERM) 12:29:33.394856 --- ParallelTerminationStrategy: PID 8158 died... 12:29:33.415011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8158): Terminated: ok {rc=0} 12:29:33.462301 --- ParallelTerminationStrategy: PID 8161 died... 12:29:33.482051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8161): Terminated: ok {rc=0} 12:29:33.529055 --- ParallelTerminationStrategy: PID 8164 died... 12:29:33.548745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8164): Terminated: ok {rc=0} 12:29:33.637522 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 encryption register_a5_0_authreq.py ---------------------------------------------- 12:29:34.788935 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:34.800477 tst encryption: Using 1 x bts (candidates: 1) 12:29:34.837926 tst register_a5_0_authreq.py: using LAC 28404 12:29:34.966489 tst register_a5_0_authreq.py: using RAC 99 12:29:35.094819 tst register_a5_0_authreq.py: using CellId 28404 12:29:35.222130 tst register_a5_0_authreq.py: using BVCI 28405 12:29:35.340190 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:35.350999 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:35.361746 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:35.372560 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:35.383504 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:35.394349 tst encryption: Using 1 x modem (candidates: 1) 12:29:35.511329 tst register_a5_0_authreq.py:8: start network... 12:29:35.717209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:36.187134 run create_hlr_db(pid=8167): Launched 12:29:36.311725 bus /sierra_2: Setting Powered False 12:29:37.373405 run create_hlr_db(pid=8167): Terminated: ok {rc=0} 12:29:37.818931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8169): Launched 12:29:38.145253 run osmo-hlr_10.42.42.2(pid=8170): Launched 12:29:38.270469 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:38.834056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8172): Launched 12:29:39.158907 run osmo-stp_10.42.42.5(pid=8173): Launched 12:29:39.283154 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:39.872202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8175): Launched 12:29:40.198706 run osmo-msc_10.42.42.6(pid=8176): Launched 12:29:40.379998 run osmo-stp_10.42.42.5(pid=8173): ERR: Terminated: ERROR {rc=1} [trial-2374↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8173)] 12:29:40.517350 run osmo-stp_10.42.42.5(pid=8173): stdout: | (launched: 2022-12-10_12:29:39.100260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:40.655174 run osmo-stp_10.42.42.5(pid=8173): stderr: | 20221210122939294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122939294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122939294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122939295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122939295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122939295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122939295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:40.791916 run osmo-stp_10.42.42.5(pid=8173): stdout: | (launched: 2022-12-10_12:29:39.100260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:40.922985 run osmo-stp_10.42.42.5(pid=8173): stderr: | 20221210122939294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122939294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122939294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122939295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122939295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122939295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122939295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:41.078700 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8173): Process ended prematurely: osmo-stp_10.42.42.5(pid=8173) [trial-2374↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8173)] [trial-2374↪encryption↪register_a5_0_authreq.py:8] 12:29:41.088344 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 12:29:41.116550 run osmo-hlr_10.42.42.2(pid=8170): ERR: Terminated: ERROR {rc=237} [trial-2374↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8170)] 12:29:41.166320 run osmo-hlr_10.42.42.2(pid=8170): stdout: | (launched: 2022-12-10_12:29:38.086389) 12:29:41.218091 run osmo-hlr_10.42.42.2(pid=8170): stderr: | 20221210122938284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122938284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122938284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122938284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122938284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122938284 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122938299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122938309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122938310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122938310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:41.289869 run osmo-msc_10.42.42.6(pid=8176): ERR: Terminated: ERROR {rc=2} [trial-2374↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8176)] 12:29:41.339923 run osmo-msc_10.42.42.6(pid=8176): stdout: | (launched: 2022-12-10_12:29:40.139619) 12:29:41.391653 run osmo-msc_10.42.42.6(pid=8176): stderr: | 20221210122940464 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122940464 DLGLOBAL DEBUG validating counter group 0x7f82e2edcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122940464 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122940464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122940464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122940464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122940466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122940466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122940466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122940467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:41.443686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8169): Terminating (SIGTERM) 12:29:41.485381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8172): Terminating (SIGTERM) 12:29:41.527046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8175): Terminating (SIGTERM) 12:29:41.569060 --- ParallelTerminationStrategy: PID 8169 died... 12:29:41.588759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8169): Terminated: ok {rc=0} 12:29:41.635359 --- ParallelTerminationStrategy: PID 8172 died... 12:29:41.654931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8172): Terminated: ok {rc=0} 12:29:41.701215 --- ParallelTerminationStrategy: PID 8175 died... 12:29:41.720618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8175): Terminated: ok {rc=0} 12:29:41.809989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 encryption register_a5_1_authreq.py ---------------------------------------------- 12:29:42.962105 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:42.973733 tst encryption: Using 1 x bts (candidates: 1) 12:29:43.011448 tst register_a5_1_authreq.py: using LAC 28405 12:29:43.139766 tst register_a5_1_authreq.py: using RAC 100 12:29:43.267129 tst register_a5_1_authreq.py: using CellId 28405 12:29:43.395420 tst register_a5_1_authreq.py: using BVCI 28406 12:29:43.513160 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:43.523969 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:43.534677 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:43.545594 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:43.556519 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:43.567443 tst encryption: Using 1 x modem (candidates: 1) 12:29:43.681139 tst register_a5_1_authreq.py:8: start network... 12:29:43.887933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:44.359479 run create_hlr_db(pid=8178): Launched 12:29:44.487555 bus /sierra_2: Setting Powered False 12:29:45.547616 run create_hlr_db(pid=8178): Terminated: ok {rc=0} 12:29:45.998952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8180): Launched 12:29:46.333737 run osmo-hlr_10.42.42.2(pid=8181): Launched 12:29:46.564042 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:47.268508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8183): Launched 12:29:47.575774 run osmo-stp_10.42.42.5(pid=8184): Launched 12:29:47.691942 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:48.239411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8186): Launched 12:29:48.543092 run osmo-msc_10.42.42.6(pid=8187): Launched 12:29:48.714040 run osmo-stp_10.42.42.5(pid=8184): ERR: Terminated: ERROR {rc=1} [trial-2374↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8184)] 12:29:48.842454 run osmo-stp_10.42.42.5(pid=8184): stdout: | (launched: 2022-12-10_12:29:47.520310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:48.970505 run osmo-stp_10.42.42.5(pid=8184): stderr: | 20221210122947690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122947690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122947691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122947691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122947693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122947693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122947694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:49.096363 run osmo-stp_10.42.42.5(pid=8184): stdout: | (launched: 2022-12-10_12:29:47.520310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:49.217439 run osmo-stp_10.42.42.5(pid=8184): stderr: | 20221210122947690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122947690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122947691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122947691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122947693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122947693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122947694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:49.361947 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8184): Process ended prematurely: osmo-stp_10.42.42.5(pid=8184) [trial-2374↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8184)] [trial-2374↪encryption↪register_a5_1_authreq.py:8] 12:29:49.370742 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 12:29:49.396705 run osmo-hlr_10.42.42.2(pid=8181): ERR: Terminated: ERROR {rc=237} [trial-2374↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8181)] 12:29:49.445088 run osmo-hlr_10.42.42.2(pid=8181): stdout: | (launched: 2022-12-10_12:29:46.263493) 12:29:49.495477 run osmo-hlr_10.42.42.2(pid=8181): stderr: | 20221210122946568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122946568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122946568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122946568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122946568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122946568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122946587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122946600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122946600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122946600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:49.563957 run osmo-msc_10.42.42.6(pid=8187): ERR: Terminated: ERROR {rc=2} [trial-2374↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8187)] 12:29:49.611439 run osmo-msc_10.42.42.6(pid=8187): stdout: | (launched: 2022-12-10_12:29:48.487621) 12:29:49.660368 run osmo-msc_10.42.42.6(pid=8187): stderr: | 20221210122948761 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122948761 DLGLOBAL DEBUG validating counter group 0x7f10691abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122948761 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122948762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122948762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122948762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122948765 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122948765 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122948765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122948765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:49.709644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8180): Terminating (SIGTERM) 12:29:49.748929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8183): Terminating (SIGTERM) 12:29:49.788321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8186): Terminating (SIGTERM) 12:29:49.828006 --- ParallelTerminationStrategy: PID 8180 died... 12:29:49.847264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8180): Terminated: ok {rc=0} 12:29:49.891221 --- ParallelTerminationStrategy: PID 8183 died... 12:29:49.909816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8183): Terminated: ok {rc=0} 12:29:49.953406 --- ParallelTerminationStrategy: PID 8186 died... 12:29:49.971918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8186): Terminated: ok {rc=0} 12:29:50.055383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2374 encryption register_a5_3_authreq.py ---------------------------------------------- 12:29:51.206870 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:51.218629 tst encryption: Using 1 x bts (candidates: 1) 12:29:51.257141 tst register_a5_3_authreq.py: using LAC 28406 12:29:51.386196 tst register_a5_3_authreq.py: using RAC 101 12:29:51.516044 tst register_a5_3_authreq.py: using CellId 28406 12:29:51.643446 tst register_a5_3_authreq.py: using BVCI 28407 12:29:51.762727 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:51.773746 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:51.784424 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:51.795875 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:51.807414 tst encryption: Using 1 x ip_address (candidates: 6) 12:29:51.818754 tst encryption: Using 1 x modem (candidates: 1) 12:29:51.949099 tst register_a5_3_authreq.py:8: start network... 12:29:52.170732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:52.675106 run create_hlr_db(pid=8189): Launched 12:29:52.799826 bus /sierra_2: Setting Powered False 12:29:53.863954 run create_hlr_db(pid=8189): Terminated: ok {rc=0} 12:29:54.299332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8191): Launched 12:29:54.603174 run osmo-hlr_10.42.42.2(pid=8192): Launched 12:29:54.719038 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:55.238413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8194): Launched 12:29:55.540139 run osmo-stp_10.42.42.5(pid=8195): Launched 12:29:55.655643 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:56.203897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8197): Launched 12:29:56.508237 run osmo-msc_10.42.42.6(pid=8198): Launched 12:29:56.678198 run osmo-stp_10.42.42.5(pid=8195): ERR: Terminated: ERROR {rc=1} [trial-2374↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8195)] 12:29:56.806613 run osmo-stp_10.42.42.5(pid=8195): stdout: | (launched: 2022-12-10_12:29:55.485207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:56.935003 run osmo-stp_10.42.42.5(pid=8195): stderr: | 20221210122955657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122955657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122955658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122955658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122955658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122955659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122955659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:57.061377 run osmo-stp_10.42.42.5(pid=8195): stdout: | (launched: 2022-12-10_12:29:55.485207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:57.182415 run osmo-stp_10.42.42.5(pid=8195): stderr: | 20221210122955657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210122955657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210122955658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210122955658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210122955658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210122955659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210122955659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:57.327518 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8195): Process ended prematurely: osmo-stp_10.42.42.5(pid=8195) [trial-2374↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8195)] [trial-2374↪encryption↪register_a5_3_authreq.py:8] 12:29:57.336524 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 12:29:57.362758 run osmo-hlr_10.42.42.2(pid=8192): ERR: Terminated: ERROR {rc=237} [trial-2374↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8192)] 12:29:57.410155 run osmo-hlr_10.42.42.2(pid=8192): stdout: | (launched: 2022-12-10_12:29:54.547857) 12:29:57.459157 run osmo-hlr_10.42.42.2(pid=8192): stderr: | 20221210122954724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210122954724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210122954724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210122954725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210122954725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210122954725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210122954736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210122954745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210122954745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210122954745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:57.527488 run osmo-msc_10.42.42.6(pid=8198): ERR: Terminated: ERROR {rc=2} [trial-2374↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8198)] 12:29:57.574804 run osmo-msc_10.42.42.6(pid=8198): stdout: | (launched: 2022-12-10_12:29:56.452442) 12:29:57.623548 run osmo-msc_10.42.42.6(pid=8198): stderr: | 20221210122956725 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210122956725 DLGLOBAL DEBUG validating counter group 0x7f6fdd12dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210122956725 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210122956725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210122956726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210122956726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210122956728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210122956729 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210122956729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210122956729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:57.672370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8191): Terminating (SIGTERM) 12:29:57.711519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8194): Terminating (SIGTERM) 12:29:57.750835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8197): Terminating (SIGTERM) 12:29:57.790503 --- ParallelTerminationStrategy: PID 8191 died... 12:29:57.809438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8191): Terminated: ok {rc=0} 12:29:57.853080 --- ParallelTerminationStrategy: PID 8194 died... 12:29:57.871686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8194): Terminated: ok {rc=0} 12:29:57.915668 --- ParallelTerminationStrategy: PID 8197 died... 12:29:57.934442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8197): Terminated: ok {rc=0} 12:29:58.019895 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 12:29:59.226811 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:29:59.231972 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 12:29:59.250162 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 12:29:59.277493 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 12:29:59.303406 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 12:29:59.321262 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 12:29:59.347115 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 12:29:59.860589 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 12:29:59.865390 tst handover.py:11: TEST_CONFIG: {} 12:30:00.067739 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:30:00.083536 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:30:00.106119 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:30:00.152787 tst handover.py: using MSISDN 7740 12:30:00.263910 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7740', subscriber_id=0} 12:30:00.369375 run srsepc_10.42.42.118: Starting srsepc 12:30:02.253743 run rm-remote-dir(pid=8208): Launched 12:30:02.402690 bus /sierra_2: Setting Powered False 12:30:03.466925 run rm-remote-dir(pid=8208): Terminated: ok {rc=0} 12:30:03.930593 run mk-remote-dir(pid=8209): Launched 12:30:05.120381 run mk-remote-dir(pid=8209): Terminated: ok {rc=0} 12:30:05.422961 run scp-inst-to-remote(pid=8210): Launched 12:30:07.610834 run scp-inst-to-remote(pid=8210): Terminated: ok {rc=0} 12:30:07.964490 run rm-remote-dir(pid=8212): Launched 12:30:09.153615 run rm-remote-dir(pid=8212): Terminated: ok {rc=0} 12:30:09.509068 run mk-remote-dir(pid=8213): Launched 12:30:10.699015 run mk-remote-dir(pid=8213): Terminated: ok {rc=0} 12:30:11.001582 run scp-cfg-to-remote(pid=8215): Launched 12:30:12.188157 run scp-cfg-to-remote(pid=8215): Terminated: ok {rc=0} 12:30:12.488707 run scp-db-to-remote(pid=8217): Launched 12:30:13.676376 run scp-db-to-remote(pid=8217): Terminated: ok {rc=0} 12:30:13.815576 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:30:14.143055 run patchelf(pid=8219): Launched 12:30:15.329600 run patchelf(pid=8219): Terminated: ok {rc=0} 12:30:15.468194 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:30:15.795123 run setcap-netadm(pid=8220): Launched 12:30:17.019473 run setcap-netadm(pid=8220): Terminated: ok {rc=0} 12:30:17.358863 run srsepc(pid=8221): Launched 12:30:17.479344 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:30:18.646219 run rm-remote-dir(pid=8222): Launched 12:30:18.831729 run srsepc(pid=8221): ERR: Terminated: ERROR {rc=127} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8221)] 12:30:18.974386 run srsepc(pid=8221): stdout: | (launched: 2022-12-10_12:30:17.299939) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:30:19.116913 run srsepc(pid=8221): stderr: | (launched: 2022-12-10_12:30:17.348360) | Connection to 10.42.42.116 closed. 12:30:19.259715 run srsepc(pid=8221): stdout: | (launched: 2022-12-10_12:30:17.299939) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:30:19.396725 run srsepc(pid=8221): stderr: | (launched: 2022-12-10_12:30:17.348360) | Connection to 10.42.42.116 closed. 12:30:19.559183 run rm-remote-dir(pid=8222): Terminating (SIGINT) 12:30:19.746826 run rm-remote-dir(pid=8222): Terminated: ok {rc=0} 12:30:19.883083 tst handover.py:37: ERR: Error: srsepc(pid=8221): Process ended prematurely: srsepc(pid=8221) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8221)] [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 12:30:19.893624 tst handover.py:37: Test FAILED (20.0 sec) 12:30:19.974177 run scp-back-log(pid=8223): Launched 12:30:21.055214 run scp-back-log(pid=8223): ERR: Terminated: ERROR {rc=1} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8223)] 12:30:21.118893 run scp-back-log(pid=8223): stdout: | (launched: 2022-12-10_12:30:19.942850) 12:30:21.184396 run scp-back-log(pid=8223): stderr: | (launched: 2022-12-10_12:30:19.963543) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:30:21.257757 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8223): launch_sync(): local process exited with status 1 [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8223)]') ---------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 12:30:21.305225 tst iperf3_bidir.py:13: Number of physical ue: 1 12:30:21.524259 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:30:21.567003 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 12:30:21.785696 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:30:21.802039 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:30:21.834569 tst iperf3_bidir.py: using MSISDN 7741 12:30:21.953136 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7741', subscriber_id=0} 12:30:22.067085 run srsepc_10.42.42.118: Starting srsepc 12:30:22.732508 run rm-remote-dir(pid=8225): Launched 12:30:23.921503 run rm-remote-dir(pid=8225): Terminated: ok {rc=0} 12:30:24.277796 run mk-remote-dir(pid=8226): Launched 12:30:25.466995 run mk-remote-dir(pid=8226): Terminated: ok {rc=0} 12:30:25.768791 run scp-inst-to-remote(pid=8227): Launched 12:30:27.954157 run scp-inst-to-remote(pid=8227): Terminated: ok {rc=0} 12:30:28.285337 run rm-remote-dir(pid=8229): Launched 12:30:29.463280 run rm-remote-dir(pid=8229): Terminated: ok {rc=0} 12:30:29.796733 run mk-remote-dir(pid=8230): Launched 12:30:30.991712 run mk-remote-dir(pid=8230): Terminated: ok {rc=0} 12:30:31.297096 run scp-cfg-to-remote(pid=8231): Launched 12:30:32.490131 run scp-cfg-to-remote(pid=8231): Terminated: ok {rc=0} 12:30:32.770967 run scp-db-to-remote(pid=8233): Launched 12:30:33.947412 run scp-db-to-remote(pid=8233): Terminated: ok {rc=0} 12:30:34.077338 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:30:34.382676 run patchelf(pid=8235): Launched 12:30:35.558472 run patchelf(pid=8235): Terminated: ok {rc=0} 12:30:35.690324 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:30:35.994941 run setcap-netadm(pid=8236): Launched 12:30:37.170836 run setcap-netadm(pid=8236): Terminated: ok {rc=0} 12:30:37.490420 run srsepc(pid=8237): Launched 12:30:37.605193 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:30:38.698532 run rm-remote-dir(pid=8238): Launched 12:30:38.874527 run srsepc(pid=8237): ERR: Terminated: ERROR {rc=127} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8237)] 12:30:39.009386 run srsepc(pid=8237): stdout: | (launched: 2022-12-10_12:30:37.434702) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:30:39.142961 run srsepc(pid=8237): stderr: | (launched: 2022-12-10_12:30:37.479754) | Connection to 10.42.42.116 closed. 12:30:39.276394 run srsepc(pid=8237): stdout: | (launched: 2022-12-10_12:30:37.434702) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:30:39.403680 run srsepc(pid=8237): stderr: | (launched: 2022-12-10_12:30:37.479754) | Connection to 10.42.42.116 closed. 12:30:39.554746 run rm-remote-dir(pid=8238): Terminating (SIGINT) 12:30:39.729809 run rm-remote-dir(pid=8238): Terminated: ok {rc=0} 12:30:39.856087 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=8237): Process ended prematurely: srsepc(pid=8237) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8237)] [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 12:30:39.866253 tst iperf3_bidir.py:42: Test FAILED (18.6 sec) 12:30:39.942180 run scp-back-log(pid=8239): Launched 12:30:41.019635 run scp-back-log(pid=8239): ERR: Terminated: ERROR {rc=1} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8239)] 12:30:41.080386 run scp-back-log(pid=8239): stdout: | (launched: 2022-12-10_12:30:39.912356) 12:30:41.142515 run scp-back-log(pid=8239): stderr: | (launched: 2022-12-10_12:30:39.932004) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:30:41.212374 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8239): launch_sync(): local process exited with status 1 [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8239)]') ---------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 12:30:41.257340 tst iperf3_dl.py:13: Number of physical ue: 1 12:30:41.459992 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:30:41.503077 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 12:30:41.702395 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:30:41.718349 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:30:41.750235 tst iperf3_dl.py: using MSISDN 7742 12:30:41.859561 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7742', subscriber_id=0} 12:30:41.965162 run srsepc_10.42.42.118: Starting srsepc 12:30:42.582915 run rm-remote-dir(pid=8241): Launched 12:30:43.761484 run rm-remote-dir(pid=8241): Terminated: ok {rc=0} 12:30:44.092788 run mk-remote-dir(pid=8242): Launched 12:30:45.270497 run mk-remote-dir(pid=8242): Terminated: ok {rc=0} 12:30:45.551878 run scp-inst-to-remote(pid=8243): Launched 12:30:47.729856 run scp-inst-to-remote(pid=8243): Terminated: ok {rc=0} 12:30:48.058430 run rm-remote-dir(pid=8245): Launched 12:30:49.235925 run rm-remote-dir(pid=8245): Terminated: ok {rc=0} 12:30:49.565823 run mk-remote-dir(pid=8246): Launched 12:30:50.743265 run mk-remote-dir(pid=8246): Terminated: ok {rc=0} 12:30:51.025031 run scp-cfg-to-remote(pid=8247): Launched 12:30:52.201906 run scp-cfg-to-remote(pid=8247): Terminated: ok {rc=0} 12:30:52.481702 run scp-db-to-remote(pid=8249): Launched 12:30:53.658128 run scp-db-to-remote(pid=8249): Terminated: ok {rc=0} 12:30:53.787619 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:30:54.091429 run patchelf(pid=8251): Launched 12:30:55.266067 run patchelf(pid=8251): Terminated: ok {rc=0} 12:30:55.395825 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:30:55.699004 run setcap-netadm(pid=8252): Launched 12:30:56.874808 run setcap-netadm(pid=8252): Terminated: ok {rc=0} 12:30:57.192762 run srsepc(pid=8253): Launched 12:30:57.306542 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:30:58.468683 run rm-remote-dir(pid=8254): Launched 12:30:58.655237 run srsepc(pid=8253): ERR: Terminated: ERROR {rc=127} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8253)] 12:30:58.797833 run srsepc(pid=8253): stdout: | (launched: 2022-12-10_12:30:57.137812) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:30:58.942031 run srsepc(pid=8253): stderr: | (launched: 2022-12-10_12:30:57.182641) | Connection to 10.42.42.116 closed. 12:30:59.085338 run srsepc(pid=8253): stdout: | (launched: 2022-12-10_12:30:57.137812) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:30:59.222646 run srsepc(pid=8253): stderr: | (launched: 2022-12-10_12:30:57.182641) | Connection to 10.42.42.116 closed. 12:30:59.386390 run rm-remote-dir(pid=8254): Terminating (SIGINT) 12:30:59.574169 run rm-remote-dir(pid=8254): Terminated: ok {rc=0} 12:30:59.710225 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=8253): Process ended prematurely: srsepc(pid=8253) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8253)] [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 12:30:59.720717 tst iperf3_dl.py:42: Test FAILED (18.5 sec) 12:30:59.802013 run scp-back-log(pid=8255): Launched 12:31:00.887758 run scp-back-log(pid=8255): ERR: Terminated: ERROR {rc=1} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8255)] 12:31:00.962788 run scp-back-log(pid=8255): stdout: | (launched: 2022-12-10_12:30:59.770850) 12:31:01.035307 run scp-back-log(pid=8255): stderr: | (launched: 2022-12-10_12:30:59.791518) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:31:01.110279 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8255): launch_sync(): local process exited with status 1 [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8255)]') ---------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 12:31:01.161118 tst iperf3_ul.py:13: Number of physical ue: 1 12:31:01.386936 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:31:01.433924 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 12:31:01.644490 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:31:01.660739 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:31:01.709119 tst iperf3_ul.py: using MSISDN 7743 12:31:01.821797 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7743', subscriber_id=0} 12:31:01.931194 run srsepc_10.42.42.118: Starting srsepc 12:31:02.560657 run rm-remote-dir(pid=8258): Launched 12:31:03.743022 run rm-remote-dir(pid=8258): Terminated: ok {rc=0} 12:31:04.099452 run mk-remote-dir(pid=8259): Launched 12:31:05.287499 run mk-remote-dir(pid=8259): Terminated: ok {rc=0} 12:31:05.590629 run scp-inst-to-remote(pid=8260): Launched 12:31:07.779101 run scp-inst-to-remote(pid=8260): Terminated: ok {rc=0} 12:31:08.133562 run rm-remote-dir(pid=8262): Launched 12:31:09.321914 run rm-remote-dir(pid=8262): Terminated: ok {rc=0} 12:31:09.677677 run mk-remote-dir(pid=8263): Launched 12:31:10.866294 run mk-remote-dir(pid=8263): Terminated: ok {rc=0} 12:31:11.170036 run scp-cfg-to-remote(pid=8264): Launched 12:31:12.356898 run scp-cfg-to-remote(pid=8264): Terminated: ok {rc=0} 12:31:12.657333 run scp-db-to-remote(pid=8266): Launched 12:31:13.846843 run scp-db-to-remote(pid=8266): Terminated: ok {rc=0} 12:31:13.986759 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:31:14.313518 run patchelf(pid=8268): Launched 12:31:15.500651 run patchelf(pid=8268): Terminated: ok {rc=0} 12:31:15.640099 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:31:16.002711 run setcap-netadm(pid=8269): Launched 12:31:17.228103 run setcap-netadm(pid=8269): Terminated: ok {rc=0} 12:31:17.572405 run srsepc(pid=8270): Launched 12:31:17.694321 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:31:18.800270 run rm-remote-dir(pid=8271): Launched 12:31:18.976646 run srsepc(pid=8270): ERR: Terminated: ERROR {rc=127} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8270)] 12:31:19.110788 run srsepc(pid=8270): stdout: | (launched: 2022-12-10_12:31:17.513511) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:31:19.243859 run srsepc(pid=8270): stderr: | (launched: 2022-12-10_12:31:17.561924) | Connection to 10.42.42.116 closed. 12:31:19.376830 run srsepc(pid=8270): stdout: | (launched: 2022-12-10_12:31:17.513511) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:31:19.504252 run srsepc(pid=8270): stderr: | (launched: 2022-12-10_12:31:17.561924) | Connection to 10.42.42.116 closed. 12:31:19.655705 run rm-remote-dir(pid=8271): Terminating (SIGINT) 12:31:19.830284 run rm-remote-dir(pid=8271): Terminated: ok {rc=0} 12:31:19.956915 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=8270): Process ended prematurely: srsepc(pid=8270) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8270)] [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 12:31:19.967014 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 12:31:20.043784 run scp-back-log(pid=8272): Launched 12:31:21.124840 run scp-back-log(pid=8272): ERR: Terminated: ERROR {rc=1} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8272)] 12:31:21.190050 run scp-back-log(pid=8272): stdout: | (launched: 2022-12-10_12:31:20.013216) 12:31:21.256539 run scp-back-log(pid=8272): stderr: | (launched: 2022-12-10_12:31:20.032817) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:31:21.331108 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8272): launch_sync(): local process exited with status 1 [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8272)]') ---------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 12:31:21.380084 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:31:21.397293 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:31:21.422090 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:31:21.479206 tst ping.py: using MSISDN 7744 12:31:21.592820 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7744', subscriber_id=0} 12:31:21.704860 run srsepc_10.42.42.118: Starting srsepc 12:31:22.375404 run rm-remote-dir(pid=8274): Launched 12:31:23.565619 run rm-remote-dir(pid=8274): Terminated: ok {rc=0} 12:31:23.921234 run mk-remote-dir(pid=8275): Launched 12:31:25.110130 run mk-remote-dir(pid=8275): Terminated: ok {rc=0} 12:31:25.413256 run scp-inst-to-remote(pid=8276): Launched 12:31:27.601532 run scp-inst-to-remote(pid=8276): Terminated: ok {rc=0} 12:31:27.954598 run rm-remote-dir(pid=8278): Launched 12:31:29.142153 run rm-remote-dir(pid=8278): Terminated: ok {rc=0} 12:31:29.497946 run mk-remote-dir(pid=8279): Launched 12:31:30.687345 run mk-remote-dir(pid=8279): Terminated: ok {rc=0} 12:31:31.012932 run scp-cfg-to-remote(pid=8280): Launched 12:31:32.241153 run scp-cfg-to-remote(pid=8280): Terminated: ok {rc=0} 12:31:32.525834 run scp-db-to-remote(pid=8282): Launched 12:31:33.702626 run scp-db-to-remote(pid=8282): Terminated: ok {rc=0} 12:31:33.832058 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:31:34.136810 run patchelf(pid=8284): Launched 12:31:35.312623 run patchelf(pid=8284): Terminated: ok {rc=0} 12:31:35.442201 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:31:35.746449 run setcap-netadm(pid=8285): Launched 12:31:36.922504 run setcap-netadm(pid=8285): Terminated: ok {rc=0} 12:31:37.240634 run srsepc(pid=8286): Launched 12:31:37.354933 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:31:38.451813 run rm-remote-dir(pid=8287): Launched 12:31:38.628220 run srsepc(pid=8286): ERR: Terminated: ERROR {rc=127} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8286)] 12:31:38.763422 run srsepc(pid=8286): stdout: | (launched: 2022-12-10_12:31:37.185085) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:31:38.897300 run srsepc(pid=8286): stderr: | (launched: 2022-12-10_12:31:37.230207) | Connection to 10.42.42.116 closed. 12:31:39.031080 run srsepc(pid=8286): stdout: | (launched: 2022-12-10_12:31:37.185085) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:31:39.159063 run srsepc(pid=8286): stderr: | (launched: 2022-12-10_12:31:37.230207) | Connection to 10.42.42.116 closed. 12:31:39.310658 run rm-remote-dir(pid=8287): Terminating (SIGINT) 12:31:39.486502 run rm-remote-dir(pid=8287): Terminated: ok {rc=0} 12:31:39.613388 tst ping.py:16: ERR: Error: srsepc(pid=8286): Process ended prematurely: srsepc(pid=8286) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8286)] [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 12:31:39.623253 tst ping.py:16: Test FAILED (18.2 sec) 12:31:39.699397 run scp-back-log(pid=8288): Launched 12:31:40.775792 run scp-back-log(pid=8288): ERR: Terminated: ERROR {rc=1} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8288)] 12:31:40.836028 run scp-back-log(pid=8288): stdout: | (launched: 2022-12-10_12:31:39.669572) 12:31:40.897829 run scp-back-log(pid=8288): stderr: | (launched: 2022-12-10_12:31:39.689108) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:31:40.967299 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8288): launch_sync(): local process exited with status 1 [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8288)]') ---------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 12:31:41.012927 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:31:41.029536 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:31:41.051694 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:31:41.100922 tst rrc_idle_mo_ping.py: using MSISDN 7745 12:31:41.212750 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7745', subscriber_id=0} 12:31:41.317748 run srsepc_10.42.42.118: Starting srsepc 12:31:41.936349 run rm-remote-dir(pid=8290): Launched 12:31:43.115191 run rm-remote-dir(pid=8290): Terminated: ok {rc=0} 12:31:43.449765 run mk-remote-dir(pid=8291): Launched 12:31:44.627390 run mk-remote-dir(pid=8291): Terminated: ok {rc=0} 12:31:44.910105 run scp-inst-to-remote(pid=8292): Launched 12:31:47.113296 run scp-inst-to-remote(pid=8292): Terminated: ok {rc=0} 12:31:47.480255 run rm-remote-dir(pid=8294): Launched 12:31:48.690435 run rm-remote-dir(pid=8294): Terminated: ok {rc=0} 12:31:49.023251 run mk-remote-dir(pid=8295): Launched 12:31:50.201728 run mk-remote-dir(pid=8295): Terminated: ok {rc=0} 12:31:50.484366 run scp-cfg-to-remote(pid=8296): Launched 12:31:51.661645 run scp-cfg-to-remote(pid=8296): Terminated: ok {rc=0} 12:31:51.942861 run scp-db-to-remote(pid=8298): Launched 12:31:53.118797 run scp-db-to-remote(pid=8298): Terminated: ok {rc=0} 12:31:53.248257 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:31:53.551890 run patchelf(pid=8300): Launched 12:31:54.727228 run patchelf(pid=8300): Terminated: ok {rc=0} 12:31:54.856869 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:31:55.161019 run setcap-netadm(pid=8301): Launched 12:31:56.336876 run setcap-netadm(pid=8301): Terminated: ok {rc=0} 12:31:56.655235 run srsepc(pid=8302): Launched 12:31:56.769459 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:31:57.936706 run rm-remote-dir(pid=8303): Launched 12:31:58.122667 run srsepc(pid=8302): ERR: Terminated: ERROR {rc=127} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8302)] 12:31:58.264743 run srsepc(pid=8302): stdout: | (launched: 2022-12-10_12:31:56.600067) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:31:58.407966 run srsepc(pid=8302): stderr: | (launched: 2022-12-10_12:31:56.644803) | Connection to 10.42.42.116 closed. 12:31:58.551009 run srsepc(pid=8302): stdout: | (launched: 2022-12-10_12:31:56.600067) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:31:58.687417 run srsepc(pid=8302): stderr: | (launched: 2022-12-10_12:31:56.644803) | Connection to 10.42.42.116 closed. 12:31:58.849286 run rm-remote-dir(pid=8303): Terminating (SIGINT) 12:31:59.037488 run rm-remote-dir(pid=8303): Terminated: ok {rc=0} 12:31:59.172860 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=8302): Process ended prematurely: srsepc(pid=8302) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8302)] [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 12:31:59.183566 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 12:31:59.263866 run scp-back-log(pid=8304): Launched 12:32:00.343632 run scp-back-log(pid=8304): ERR: Terminated: ERROR {rc=1} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8304)] 12:32:00.407063 run scp-back-log(pid=8304): stdout: | (launched: 2022-12-10_12:31:59.232610) 12:32:00.472350 run scp-back-log(pid=8304): stderr: | (launched: 2022-12-10_12:31:59.253478) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:32:00.546028 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8304): launch_sync(): local process exited with status 1 [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8304)]') ---------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 12:32:00.594001 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:32:00.611135 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:32:00.634801 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:32:00.684552 tst rrc_idle_mt_ping.py: using MSISDN 7746 12:32:00.805201 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7746', subscriber_id=0} 12:32:00.925812 run srsepc_10.42.42.118: Starting srsepc 12:32:01.613724 run rm-remote-dir(pid=8306): Launched 12:32:02.861467 run rm-remote-dir(pid=8306): Terminated: ok {rc=0} 12:32:03.219032 run mk-remote-dir(pid=8307): Launched 12:32:04.408415 run mk-remote-dir(pid=8307): Terminated: ok {rc=0} 12:32:04.712459 run scp-inst-to-remote(pid=8308): Launched 12:32:06.901547 run scp-inst-to-remote(pid=8308): Terminated: ok {rc=0} 12:32:07.257091 run rm-remote-dir(pid=8310): Launched 12:32:08.442645 run rm-remote-dir(pid=8310): Terminated: ok {rc=0} 12:32:08.776521 run mk-remote-dir(pid=8311): Launched 12:32:09.957255 run mk-remote-dir(pid=8311): Terminated: ok {rc=0} 12:32:10.240814 run scp-cfg-to-remote(pid=8312): Launched 12:32:11.417466 run scp-cfg-to-remote(pid=8312): Terminated: ok {rc=0} 12:32:11.719816 run scp-db-to-remote(pid=8314): Launched 12:32:12.906961 run scp-db-to-remote(pid=8314): Terminated: ok {rc=0} 12:32:13.047545 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:32:13.374555 run patchelf(pid=8316): Launched 12:32:14.561890 run patchelf(pid=8316): Terminated: ok {rc=0} 12:32:14.701391 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:32:15.029519 run setcap-netadm(pid=8317): Launched 12:32:16.227059 run setcap-netadm(pid=8317): Terminated: ok {rc=0} 12:32:16.601736 run srsepc(pid=8318): Launched 12:32:16.763088 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:32:17.937046 run rm-remote-dir(pid=8319): Launched 12:32:18.113741 run srsepc(pid=8318): ERR: Terminated: ERROR {rc=127} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8318)] 12:32:18.248445 run srsepc(pid=8318): stdout: | (launched: 2022-12-10_12:32:16.524751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:32:18.381830 run srsepc(pid=8318): stderr: | (launched: 2022-12-10_12:32:16.571128) | Connection to 10.42.42.116 closed. 12:32:18.515075 run srsepc(pid=8318): stdout: | (launched: 2022-12-10_12:32:16.524751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:32:18.642810 run srsepc(pid=8318): stderr: | (launched: 2022-12-10_12:32:16.571128) | Connection to 10.42.42.116 closed. 12:32:18.793959 run rm-remote-dir(pid=8319): Terminating (SIGINT) 12:32:18.970026 run rm-remote-dir(pid=8319): Terminated: ok {rc=0} 12:32:19.097855 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=8318): Process ended prematurely: srsepc(pid=8318) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8318)] [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 12:32:19.107810 tst rrc_idle_mt_ping.py:16: Test FAILED (18.5 sec) 12:32:19.184203 run scp-back-log(pid=8320): Launched 12:32:20.261882 run scp-back-log(pid=8320): ERR: Terminated: ERROR {rc=1} [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8320)] 12:32:20.322497 run scp-back-log(pid=8320): stdout: | (launched: 2022-12-10_12:32:19.154362) 12:32:20.384112 run scp-back-log(pid=8320): stderr: | (launched: 2022-12-10_12:32:19.174105) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:32:20.453694 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8320): launch_sync(): local process exited with status 1 [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8320)]') --------------------------------------------------------------------- trial-2374 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 12:32:20.582306 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:20.587250 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 12:32:20.627084 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 12:32:20.652985 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 12:32:20.703820 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 12:32:20.745039 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 12:32:20.770880 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 12:32:21.319324 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 12:32:21.324500 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:32:21.335229 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:32:21.372380 tst handover.py: using LAC 28407 12:32:21.501055 tst handover.py: using RAC 102 12:32:21.626359 tst handover.py: using CellId 28407 12:32:21.753299 tst handover.py: using BVCI 28408 12:32:21.869534 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:32:21.904517 tst handover.py: using LAC 28408 12:32:22.030308 tst handover.py: using RAC 103 12:32:22.157732 tst handover.py: using CellId 28408 12:32:22.282506 tst handover.py: using BVCI 28409 12:32:22.398310 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:32:22.409494 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:32:22.420275 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:32:22.431438 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:32:22.442804 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:32:22.453990 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:32:22.571765 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:32:22.688068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:23.154447 run create_hlr_db(pid=8327): Launched 12:32:24.322692 run create_hlr_db(pid=8327): Terminated: ok {rc=0} 12:32:24.637934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8329): Launched 12:32:24.935435 run osmo-hlr_10.42.42.2(pid=8330): Launched 12:32:25.049525 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:25.560858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8332): Launched 12:32:25.891914 run osmo-stp_10.42.42.5(pid=8336): Launched 12:32:26.017042 run osmo-msc_10.42.42.6: Starting osmo-msc 12:32:26.598783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8338): Launched 12:32:26.919430 run osmo-msc_10.42.42.6(pid=8339): Launched 12:32:27.099238 run osmo-stp_10.42.42.5(pid=8336): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] 12:32:27.234924 run osmo-stp_10.42.42.5(pid=8336): stdout: | (launched: 2022-12-10_12:32:25.833508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:27.370848 run osmo-stp_10.42.42.5(pid=8336): stderr: | 20221210123226022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123226022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123226023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123226023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123226025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123226025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123226025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:27.506099 run osmo-stp_10.42.42.5(pid=8336): stdout: | (launched: 2022-12-10_12:32:25.833508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:27.634285 run osmo-stp_10.42.42.5(pid=8336): stderr: | 20221210123226022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123226022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123226023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123226023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123226025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123226025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123226025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:27.787095 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8336): Process ended prematurely: osmo-stp_10.42.42.5(pid=8336) [trial-2374↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] [trial-2374↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 12:32:27.795929 tst handover.py:18: Test FAILED (6.5 sec) 12:32:27.823626 run osmo-hlr_10.42.42.2(pid=8330): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8330)] 12:32:27.873874 run osmo-hlr_10.42.42.2(pid=8330): stdout: | (launched: 2022-12-10_12:32:24.881370) 12:32:27.926014 run osmo-hlr_10.42.42.2(pid=8330): stderr: | 20221210123225056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123225056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123225056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123225056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123225056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123225056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123225067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123225076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123225077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123225077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:27.998114 run osmo-msc_10.42.42.6(pid=8339): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8339)] 12:32:28.048246 run osmo-msc_10.42.42.6(pid=8339): stdout: | (launched: 2022-12-10_12:32:26.861159) 12:32:28.099914 run osmo-msc_10.42.42.6(pid=8339): stderr: | 20221210123227181 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123227181 DLGLOBAL DEBUG validating counter group 0x7f19aca7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123227181 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123227181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123227181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123227181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123227183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123227183 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123227184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123227184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:32:28.152082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8329): Terminating (SIGTERM) 12:32:28.194097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8332): Terminating (SIGTERM) 12:32:28.236504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8338): Terminating (SIGTERM) 12:32:28.279071 --- ParallelTerminationStrategy: PID 8329 died... 12:32:28.299078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8329): Terminated: ok {rc=0} 12:32:28.346422 --- ParallelTerminationStrategy: PID 8332 died... 12:32:28.366027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8332): Terminated: ok {rc=0} 12:32:28.412613 --- ParallelTerminationStrategy: PID 8338 died... 12:32:28.432198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8338): Terminated: ok {rc=0} 12:32:28.520746 bus /sierra_3: Setting Powered False 12:32:29.619748 bus /sierra_3: Setting Powered False 12:32:30.732841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 12:32:32.002701 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:32.010772 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:32:32.060037 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:32:32.093562 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:32:32.151476 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:32:32.202272 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:32:32.234494 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:32:32.768293 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 12:32:32.773338 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:32:32.783932 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:32:32.820547 tst handover.py: using LAC 28409 12:32:32.936763 tst handover.py: using RAC 104 12:32:33.056561 tst handover.py: using CellId 28409 12:32:33.173974 tst handover.py: using BVCI 28410 12:32:33.281569 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:32:33.313824 tst handover.py: using LAC 28410 12:32:33.431835 tst handover.py: using RAC 105 12:32:33.546604 tst handover.py: using CellId 28410 12:32:33.662354 tst handover.py: using BVCI 28411 12:32:33.771761 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:32:33.782402 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:32:33.792822 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:32:33.803377 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:32:33.813900 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:32:33.824233 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:32:33.940112 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:32:34.057375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:34.526924 run create_hlr_db(pid=8344): Launched 12:32:34.657979 bus /sierra_2: Setting Powered False 12:32:35.721203 run create_hlr_db(pid=8344): Terminated: ok {rc=0} 12:32:36.127646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Launched 12:32:36.427065 run osmo-hlr_10.42.42.2(pid=8347): Launched 12:32:36.541268 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:37.043730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Launched 12:32:37.342830 run osmo-stp_10.42.42.5(pid=8350): Launched 12:32:37.457268 run osmo-msc_10.42.42.6: Starting osmo-msc 12:32:37.975270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8352): Launched 12:32:38.275177 run osmo-msc_10.42.42.6(pid=8353): Launched 12:32:38.442807 run osmo-stp_10.42.42.5(pid=8350): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] 12:32:38.569660 run osmo-stp_10.42.42.5(pid=8350): stdout: | (launched: 2022-12-10_12:32:37.288518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:38.695877 run osmo-stp_10.42.42.5(pid=8350): stderr: | 20221210123237457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123237457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123237457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123237458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123237458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123237458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123237458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:38.820352 run osmo-stp_10.42.42.5(pid=8350): stdout: | (launched: 2022-12-10_12:32:37.288518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:38.940319 run osmo-stp_10.42.42.5(pid=8350): stderr: | 20221210123237457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123237457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123237457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123237458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123237458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123237458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123237458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:39.083225 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8350): Process ended prematurely: osmo-stp_10.42.42.5(pid=8350) [trial-2374↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] [trial-2374↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 12:32:39.091422 tst handover.py:18: Test FAILED (6.3 sec) 12:32:39.117135 run osmo-hlr_10.42.42.2(pid=8347): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8347)] 12:32:39.164061 run osmo-hlr_10.42.42.2(pid=8347): stdout: | (launched: 2022-12-10_12:32:36.372499) 12:32:39.212570 run osmo-hlr_10.42.42.2(pid=8347): stderr: | 20221210123236548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123236548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123236548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123236548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123236548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123236548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123236560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123236569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123236570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123236570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:39.280304 run osmo-msc_10.42.42.6(pid=8353): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8353)] 12:32:39.327031 run osmo-msc_10.42.42.6(pid=8353): stdout: | (launched: 2022-12-10_12:32:38.220305) 12:32:39.375259 run osmo-msc_10.42.42.6(pid=8353): stderr: | 20221210123238491 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123238491 DLGLOBAL DEBUG validating counter group 0x7f9805040c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123238491 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123238491 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123238492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123238492 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123238495 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123238495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123238495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123238495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:32:39.423882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Terminating (SIGTERM) 12:32:39.462622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Terminating (SIGTERM) 12:32:39.501576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8352): Terminating (SIGTERM) 12:32:39.540794 --- ParallelTerminationStrategy: PID 8346 died... 12:32:39.559527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Terminated: ok {rc=0} 12:32:39.602525 --- ParallelTerminationStrategy: PID 8349 died... 12:32:39.620560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Terminated: ok {rc=0} 12:32:39.663559 --- ParallelTerminationStrategy: PID 8352 died... 12:32:39.681809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8352): Terminated: ok {rc=0} 12:32:39.767236 bus /sierra_3: Setting Powered False 12:32:40.866271 bus /sierra_3: Setting Powered False 12:32:41.981425 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 12:32:43.223253 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:43.228398 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:32:43.280213 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:32:43.306307 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:32:43.356506 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:32:43.408321 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:32:43.434189 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:32:43.985116 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 12:32:43.990100 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:32:44.000643 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:32:44.037574 tst handover.py: using LAC 28411 12:32:44.156360 tst handover.py: using RAC 106 12:32:44.273930 tst handover.py: using CellId 28411 12:32:44.390757 tst handover.py: using BVCI 28412 12:32:44.498455 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:32:44.545160 tst handover.py: using LAC 28412 12:32:44.665568 tst handover.py: using RAC 107 12:32:44.792526 tst handover.py: using CellId 28412 12:32:44.921914 tst handover.py: using BVCI 28413 12:32:45.040181 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:32:45.051644 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:32:45.062829 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:32:45.074830 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:32:45.086912 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:32:45.098749 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:32:45.218006 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:32:45.335309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:45.803812 run create_hlr_db(pid=8358): Launched 12:32:45.972660 bus /sierra_2: Setting Powered False 12:32:47.043202 run create_hlr_db(pid=8358): Terminated: ok {rc=0} 12:32:47.476763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8360): Launched 12:32:47.777175 run osmo-hlr_10.42.42.2(pid=8361): Launched 12:32:47.892058 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:48.390518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8363): Launched 12:32:48.689432 run osmo-stp_10.42.42.5(pid=8364): Launched 12:32:48.804369 run osmo-msc_10.42.42.6: Starting osmo-msc 12:32:49.321163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8366): Launched 12:32:49.621490 run osmo-msc_10.42.42.6(pid=8367): Launched 12:32:49.791143 run osmo-stp_10.42.42.5(pid=8364): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8364)] 12:32:49.918652 run osmo-stp_10.42.42.5(pid=8364): stdout: | (launched: 2022-12-10_12:32:48.634055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:50.045735 run osmo-stp_10.42.42.5(pid=8364): stderr: | 20221210123248804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123248804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123248804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123248805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123248805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123248805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123248805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:50.170303 run osmo-stp_10.42.42.5(pid=8364): stdout: | (launched: 2022-12-10_12:32:48.634055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:50.290042 run osmo-stp_10.42.42.5(pid=8364): stderr: | 20221210123248804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123248804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123248804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123248805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123248805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123248805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123248805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:50.432774 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8364): Process ended prematurely: osmo-stp_10.42.42.5(pid=8364) [trial-2374↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8364)] [trial-2374↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 12:32:50.441152 tst handover.py:18: Test FAILED (6.4 sec) 12:32:50.467083 run osmo-hlr_10.42.42.2(pid=8361): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8361)] 12:32:50.514276 run osmo-hlr_10.42.42.2(pid=8361): stdout: | (launched: 2022-12-10_12:32:47.722653) 12:32:50.563079 run osmo-hlr_10.42.42.2(pid=8361): stderr: | 20221210123247899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123247899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123247899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123247899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123247899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123247899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123247914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123247924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123247924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123247924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:50.631274 run osmo-msc_10.42.42.6(pid=8367): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8367)] 12:32:50.678408 run osmo-msc_10.42.42.6(pid=8367): stdout: | (launched: 2022-12-10_12:32:49.566697) 12:32:50.727126 run osmo-msc_10.42.42.6(pid=8367): stderr: | 20221210123249835 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123249836 DLGLOBAL DEBUG validating counter group 0x7f8cb71e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123249836 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123249836 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123249836 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123249836 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123249838 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123249838 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123249838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123249839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:32:50.776126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8360): Terminating (SIGTERM) 12:32:50.815178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8363): Terminating (SIGTERM) 12:32:50.854478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8366): Terminating (SIGTERM) 12:32:50.894442 --- ParallelTerminationStrategy: PID 8360 died... 12:32:50.913098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8360): Terminated: ok {rc=0} 12:32:50.956831 --- ParallelTerminationStrategy: PID 8363 died... 12:32:50.975570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8363): Terminated: ok {rc=0} 12:32:51.019011 --- ParallelTerminationStrategy: PID 8366 died... 12:32:51.037277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8366): Terminated: ok {rc=0} 12:32:51.120323 bus /sierra_3: Setting Powered False 12:32:52.217402 bus /sierra_3: Setting Powered False 12:32:53.334435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:32:54.598820 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:54.604855 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:32:54.655284 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:32:54.682484 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:32:54.737156 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:32:54.785900 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:32:54.811845 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:32:55.362912 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:32:55.368332 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:32:55.379467 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:32:55.417605 tst handover.py: using LAC 28413 12:32:55.544194 tst handover.py: using RAC 108 12:32:55.663095 tst handover.py: using CellId 28413 12:32:55.791373 tst handover.py: using BVCI 28414 12:32:55.908614 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:32:55.954962 tst handover.py: using LAC 28414 12:32:56.085252 tst handover.py: using RAC 109 12:32:56.210036 tst handover.py: using CellId 28414 12:32:56.328782 tst handover.py: using BVCI 28415 12:32:56.436694 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:32:56.447839 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:32:56.458742 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:32:56.470571 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:32:56.481971 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:32:56.493222 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:32:56.611221 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:32:56.724804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:57.195308 run create_hlr_db(pid=8373): Launched 12:32:57.326174 bus /sierra_2: Setting Powered False 12:32:58.389555 run create_hlr_db(pid=8373): Terminated: ok {rc=0} 12:32:58.792734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8375): Launched 12:32:59.093462 run osmo-hlr_10.42.42.2(pid=8376): Launched 12:32:59.208724 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:59.710650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8378): Launched 12:33:00.009353 run osmo-stp_10.42.42.5(pid=8379): Launched 12:33:00.125716 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:00.645750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8381): Launched 12:33:00.957931 run osmo-msc_10.42.42.6(pid=8382): Launched 12:33:01.228632 run osmo-stp_10.42.42.5(pid=8379): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8379)] 12:33:01.433634 run osmo-stp_10.42.42.5(pid=8379): stdout: | (launched: 2022-12-10_12:32:59.954908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:01.689184 run osmo-stp_10.42.42.5(pid=8379): stderr: | 20221210123300122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123300122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123300122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123300123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123300123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123300123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123300123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:01.817897 run osmo-stp_10.42.42.5(pid=8379): stdout: | (launched: 2022-12-10_12:32:59.954908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:01.940750 run osmo-stp_10.42.42.5(pid=8379): stderr: | 20221210123300122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123300122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123300122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123300123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123300123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123300123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123300123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:02.087734 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8379): Process ended prematurely: osmo-stp_10.42.42.5(pid=8379) [trial-2374↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8379)] [trial-2374↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 12:33:02.097094 tst handover.py:18: Test FAILED (6.7 sec) 12:33:02.126334 run osmo-hlr_10.42.42.2(pid=8376): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8376)] 12:33:02.176492 run osmo-hlr_10.42.42.2(pid=8376): stdout: | (launched: 2022-12-10_12:32:59.038635) 12:33:02.228080 run osmo-hlr_10.42.42.2(pid=8376): stderr: | 20221210123259213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123259213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123259213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123259213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123259213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123259213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123259229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123259237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123259237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123259238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:02.299313 run osmo-msc_10.42.42.6(pid=8382): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8382)] 12:33:02.349248 run osmo-msc_10.42.42.6(pid=8382): stdout: | (launched: 2022-12-10_12:33:00.892150) 12:33:02.400487 run osmo-msc_10.42.42.6(pid=8382): stderr: | 20221210123301329 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123301329 DLGLOBAL DEBUG validating counter group 0x7f919aa2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123301329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123301329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123301330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123301330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123301331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123301332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123301332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123301332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:02.452090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8375): Terminating (SIGTERM) 12:33:02.492332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8378): Terminating (SIGTERM) 12:33:02.532613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8381): Terminating (SIGTERM) 12:33:02.573197 --- ParallelTerminationStrategy: PID 8375 died... 12:33:02.592068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8375): Terminated: ok {rc=0} 12:33:02.637565 --- ParallelTerminationStrategy: PID 8378 died... 12:33:02.655927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8378): Terminated: ok {rc=0} 12:33:02.700929 --- ParallelTerminationStrategy: PID 8381 died... 12:33:02.719778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8381): Terminated: ok {rc=0} 12:33:02.806792 bus /sierra_3: Setting Powered False 12:33:03.904467 bus /sierra_3: Setting Powered False 12:33:05.020657 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:33:06.274607 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:06.281299 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:33:06.336288 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:33:06.363495 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:33:06.416131 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:33:06.470906 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:33:06.497689 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:33:07.051450 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:33:07.057352 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:33:07.068707 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:33:07.107480 tst handover.py: using LAC 28415 12:33:07.232841 tst handover.py: using RAC 110 12:33:07.351295 tst handover.py: using CellId 28415 12:33:07.478640 tst handover.py: using BVCI 28416 12:33:07.595777 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:33:07.646549 tst handover.py: using LAC 28416 12:33:07.772560 tst handover.py: using RAC 111 12:33:07.899351 tst handover.py: using CellId 28416 12:33:08.025430 tst handover.py: using BVCI 28417 12:33:08.143180 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:33:08.154477 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:33:08.165539 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:33:08.177281 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:33:08.188748 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:33:08.200344 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:33:08.315256 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:33:08.431528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:08.900163 run create_hlr_db(pid=8388): Launched 12:33:09.022028 bus /sierra_2: Setting Powered False 12:33:10.082186 run create_hlr_db(pid=8388): Terminated: ok {rc=0} 12:33:10.493318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8390): Launched 12:33:10.812727 run osmo-hlr_10.42.42.2(pid=8391): Launched 12:33:10.935114 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:11.459374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8393): Launched 12:33:11.780707 run osmo-stp_10.42.42.5(pid=8394): Launched 12:33:11.904273 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:12.457192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8396): Launched 12:33:12.777332 run osmo-msc_10.42.42.6(pid=8397): Launched 12:33:12.957872 run osmo-stp_10.42.42.5(pid=8394): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8394)] 12:33:13.093591 run osmo-stp_10.42.42.5(pid=8394): stdout: | (launched: 2022-12-10_12:33:11.722674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:13.229356 run osmo-stp_10.42.42.5(pid=8394): stderr: | 20221210123311915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123311915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123311916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123311916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123311917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123311917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123311917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:13.364286 run osmo-stp_10.42.42.5(pid=8394): stdout: | (launched: 2022-12-10_12:33:11.722674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:13.493345 run osmo-stp_10.42.42.5(pid=8394): stderr: | 20221210123311915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123311915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123311916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123311916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123311917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123311917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123311917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:13.646625 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8394): Process ended prematurely: osmo-stp_10.42.42.5(pid=8394) [trial-2374↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8394)] [trial-2374↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 12:33:13.655591 tst handover.py:18: Test FAILED (6.6 sec) 12:33:13.683126 run osmo-hlr_10.42.42.2(pid=8391): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8391)] 12:33:13.733656 run osmo-hlr_10.42.42.2(pid=8391): stdout: | (launched: 2022-12-10_12:33:10.754812) 12:33:13.785784 run osmo-hlr_10.42.42.2(pid=8391): stderr: | 20221210123310950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123310950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123310951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123310951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123310951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123310951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123310965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123310974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123310974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123310974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:13.858158 run osmo-msc_10.42.42.6(pid=8397): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8397)] 12:33:13.908361 run osmo-msc_10.42.42.6(pid=8397): stdout: | (launched: 2022-12-10_12:33:12.719163) 12:33:13.960669 run osmo-msc_10.42.42.6(pid=8397): stderr: | 20221210123313040 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123313040 DLGLOBAL DEBUG validating counter group 0x7f4cba9abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123313040 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123313040 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123313040 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123313040 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123313042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123313042 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123313043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123313043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:14.012904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8390): Terminating (SIGTERM) 12:33:14.054870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8393): Terminating (SIGTERM) 12:33:14.096674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8396): Terminating (SIGTERM) 12:33:14.138669 --- ParallelTerminationStrategy: PID 8390 died... 12:33:14.158664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8390): Terminated: ok {rc=0} 12:33:14.205268 --- ParallelTerminationStrategy: PID 8393 died... 12:33:14.224917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8393): Terminated: ok {rc=0} 12:33:14.271344 --- ParallelTerminationStrategy: PID 8396 died... 12:33:14.291267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8396): Terminated: ok {rc=0} 12:33:14.379509 bus /sierra_3: Setting Powered False 12:33:15.477608 bus /sierra_3: Setting Powered False 12:33:16.595583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 12:33:17.853882 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:17.858859 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:33:17.900068 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:33:17.926285 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:33:17.976915 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:33:18.017477 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:33:18.043367 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:33:18.592154 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 12:33:18.597395 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:33:18.608121 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:33:18.645898 tst handover.py: using LAC 28417 12:33:18.764348 tst handover.py: using RAC 112 12:33:18.882008 tst handover.py: using CellId 28417 12:33:18.998833 tst handover.py: using BVCI 28418 12:33:19.106514 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:33:19.142051 tst handover.py: using LAC 28418 12:33:19.269626 tst handover.py: using RAC 113 12:33:19.389833 tst handover.py: using CellId 28418 12:33:19.508523 tst handover.py: using BVCI 28419 12:33:19.617884 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:33:19.628796 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:33:19.639499 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:33:19.651013 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:33:19.662471 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:33:19.673873 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:33:19.787581 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:33:19.903418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:20.344396 run create_hlr_db(pid=8402): Launched 12:33:20.458738 bus /sierra_2: Setting Powered False 12:33:21.518504 run create_hlr_db(pid=8402): Terminated: ok {rc=0} 12:33:21.929508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8404): Launched 12:33:22.249522 run osmo-hlr_10.42.42.2(pid=8405): Launched 12:33:22.372235 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:22.893442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8407): Launched 12:33:23.212202 run osmo-stp_10.42.42.5(pid=8408): Launched 12:33:23.334513 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:23.885637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8410): Launched 12:33:24.207109 run osmo-msc_10.42.42.6(pid=8411): Launched 12:33:24.386738 run osmo-stp_10.42.42.5(pid=8408): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8408)] 12:33:24.523966 run osmo-stp_10.42.42.5(pid=8408): stdout: | (launched: 2022-12-10_12:33:23.154472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:24.659496 run osmo-stp_10.42.42.5(pid=8408): stderr: | 20221210123323346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123323346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123323346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123323346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123323347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123323347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123323347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:24.793949 run osmo-stp_10.42.42.5(pid=8408): stdout: | (launched: 2022-12-10_12:33:23.154472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:24.922087 run osmo-stp_10.42.42.5(pid=8408): stderr: | 20221210123323346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123323346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123323346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123323346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123323347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123323347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123323347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:25.075373 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8408): Process ended prematurely: osmo-stp_10.42.42.5(pid=8408) [trial-2374↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8408)] [trial-2374↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 12:33:25.084178 tst handover.py:18: Test FAILED (6.5 sec) 12:33:25.111413 run osmo-hlr_10.42.42.2(pid=8405): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8405)] 12:33:25.161195 run osmo-hlr_10.42.42.2(pid=8405): stdout: | (launched: 2022-12-10_12:33:22.191867) 12:33:25.212255 run osmo-hlr_10.42.42.2(pid=8405): stderr: | 20221210123322388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123322388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123322388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123322388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123322388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123322388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123322404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123322412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123322412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123322412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:25.283818 run osmo-msc_10.42.42.6(pid=8411): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8411)] 12:33:25.333527 run osmo-msc_10.42.42.6(pid=8411): stdout: | (launched: 2022-12-10_12:33:24.148756) 12:33:25.384851 run osmo-msc_10.42.42.6(pid=8411): stderr: | 20221210123324472 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123324472 DLGLOBAL DEBUG validating counter group 0x7f0e8a2d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123324472 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123324472 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123324472 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123324473 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123324474 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123324475 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123324475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123324475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:25.436326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8404): Terminating (SIGTERM) 12:33:25.477717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8407): Terminating (SIGTERM) 12:33:25.519137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8410): Terminating (SIGTERM) 12:33:25.561317 --- ParallelTerminationStrategy: PID 8404 died... 12:33:25.581147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8404): Terminated: ok {rc=0} 12:33:25.626923 --- ParallelTerminationStrategy: PID 8407 died... 12:33:25.646357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8407): Terminated: ok {rc=0} 12:33:25.691805 --- ParallelTerminationStrategy: PID 8410 died... 12:33:25.711175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8410): Terminated: ok {rc=0} 12:33:25.797773 bus /sierra_3: Setting Powered False 12:33:26.896879 bus /sierra_3: Setting Powered False 12:33:28.014185 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 12:33:29.264342 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:29.269966 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:33:29.323731 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:33:29.350665 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:33:29.402861 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:33:29.456435 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:33:29.483241 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:33:30.037131 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 12:33:30.042682 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:33:30.054006 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:33:30.093642 tst handover.py: using LAC 28419 12:33:30.225042 tst handover.py: using RAC 114 12:33:30.352467 tst handover.py: using CellId 28419 12:33:30.478311 tst handover.py: using BVCI 28420 12:33:30.594406 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:33:30.642357 tst handover.py: using LAC 28420 12:33:30.768125 tst handover.py: using RAC 115 12:33:30.904893 tst handover.py: using CellId 28420 12:33:31.038619 tst handover.py: using BVCI 28421 12:33:31.152880 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:33:31.164521 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:33:31.176162 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:33:31.188253 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:33:31.200443 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:33:31.212606 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:33:31.331079 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:33:31.448501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:31.927645 run create_hlr_db(pid=8416): Launched 12:33:32.090175 bus /sierra_2: Setting Powered False 12:33:33.153136 run create_hlr_db(pid=8416): Terminated: ok {rc=0} 12:33:33.557036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8418): Launched 12:33:33.858009 run osmo-hlr_10.42.42.2(pid=8419): Launched 12:33:33.972378 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:34.475678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8421): Launched 12:33:34.774247 run osmo-stp_10.42.42.5(pid=8422): Launched 12:33:34.889248 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:35.405306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8424): Launched 12:33:35.705592 run osmo-msc_10.42.42.6(pid=8425): Launched 12:33:35.874418 run osmo-stp_10.42.42.5(pid=8422): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8422)] 12:33:36.001412 run osmo-stp_10.42.42.5(pid=8422): stdout: | (launched: 2022-12-10_12:33:34.720015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:36.129243 run osmo-stp_10.42.42.5(pid=8422): stderr: | 20221210123334887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123334887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123334887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123334887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123334890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123334890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123334890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:36.253842 run osmo-stp_10.42.42.5(pid=8422): stdout: | (launched: 2022-12-10_12:33:34.720015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:36.373774 run osmo-stp_10.42.42.5(pid=8422): stderr: | 20221210123334887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123334887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123334887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123334887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123334890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123334890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123334890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:36.516706 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8422): Process ended prematurely: osmo-stp_10.42.42.5(pid=8422) [trial-2374↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8422)] [trial-2374↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 12:33:36.525237 tst handover.py:18: Test FAILED (6.5 sec) 12:33:36.551491 run osmo-hlr_10.42.42.2(pid=8419): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8419)] 12:33:36.599007 run osmo-hlr_10.42.42.2(pid=8419): stdout: | (launched: 2022-12-10_12:33:33.803365) 12:33:36.648182 run osmo-hlr_10.42.42.2(pid=8419): stderr: | 20221210123333978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123333978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123333978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123333978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123333978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123333979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123333990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123333999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123333999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123333999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:36.716604 run osmo-msc_10.42.42.6(pid=8425): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8425)] 12:33:36.763914 run osmo-msc_10.42.42.6(pid=8425): stdout: | (launched: 2022-12-10_12:33:35.651140) 12:33:36.812877 run osmo-msc_10.42.42.6(pid=8425): stderr: | 20221210123335920 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123335920 DLGLOBAL DEBUG validating counter group 0x7f41f8d97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123335921 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123335921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123335921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123335921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123335923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123335924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123335924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123335924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:36.862320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8418): Terminating (SIGTERM) 12:33:36.901925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8421): Terminating (SIGTERM) 12:33:36.941616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8424): Terminating (SIGTERM) 12:33:36.981766 --- ParallelTerminationStrategy: PID 8418 died... 12:33:37.000519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8418): Terminated: ok {rc=0} 12:33:37.044568 --- ParallelTerminationStrategy: PID 8421 died... 12:33:37.063050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8421): Terminated: ok {rc=0} 12:33:37.106857 --- ParallelTerminationStrategy: PID 8424 died... 12:33:37.125603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8424): Terminated: ok {rc=0} 12:33:37.211011 bus /sierra_3: Setting Powered False 12:33:38.310526 bus /sierra_3: Setting Powered False 12:33:39.426389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 12:33:40.677179 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:40.682104 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:33:40.734432 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:33:40.760281 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:33:40.811222 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:33:40.862854 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:33:40.888615 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:33:41.438900 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 12:33:41.443937 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:33:41.454694 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:33:41.499589 tst handover.py: using LAC 28421 12:33:41.627770 tst handover.py: using RAC 116 12:33:41.746849 tst handover.py: using CellId 28421 12:33:41.865372 tst handover.py: using BVCI 28422 12:33:41.973901 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:33:42.021138 tst handover.py: using LAC 28422 12:33:42.141686 tst handover.py: using RAC 117 12:33:42.269118 tst handover.py: using CellId 28422 12:33:42.389931 tst handover.py: using BVCI 28423 12:33:42.500748 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:33:42.511616 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:33:42.522422 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:33:42.533606 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:33:42.544763 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:33:42.555787 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:33:42.673850 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:33:42.788253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:43.228929 run create_hlr_db(pid=8430): Launched 12:33:43.343559 bus /sierra_2: Setting Powered False 12:33:44.404504 run create_hlr_db(pid=8430): Terminated: ok {rc=0} 12:33:44.815216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8432): Launched 12:33:45.137741 run osmo-hlr_10.42.42.2(pid=8433): Launched 12:33:45.261418 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:45.784404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8435): Launched 12:33:46.102707 run osmo-stp_10.42.42.5(pid=8436): Launched 12:33:46.378648 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:47.039355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8438): Launched 12:33:47.413291 run osmo-msc_10.42.42.6(pid=8439): Launched 12:33:47.584781 run osmo-stp_10.42.42.5(pid=8436): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8436)] 12:33:47.712871 run osmo-stp_10.42.42.5(pid=8436): stdout: | (launched: 2022-12-10_12:33:46.044106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:47.841781 run osmo-stp_10.42.42.5(pid=8436): stderr: | 20221210123346334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123346334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123346334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123346335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123346335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123346335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123346335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:47.965982 run osmo-stp_10.42.42.5(pid=8436): stdout: | (launched: 2022-12-10_12:33:46.044106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:48.085849 run osmo-stp_10.42.42.5(pid=8436): stderr: | 20221210123346334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123346334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123346334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123346335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123346335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123346335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123346335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:48.228816 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8436): Process ended prematurely: osmo-stp_10.42.42.5(pid=8436) [trial-2374↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8436)] [trial-2374↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 12:33:48.237326 tst handover.py:18: Test FAILED (6.8 sec) 12:33:48.263486 run osmo-hlr_10.42.42.2(pid=8433): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8433)] 12:33:48.311132 run osmo-hlr_10.42.42.2(pid=8433): stdout: | (launched: 2022-12-10_12:33:45.079876) 12:33:48.360608 run osmo-hlr_10.42.42.2(pid=8433): stderr: | 20221210123345279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123345279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123345279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123345279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123345279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123345279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123345291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123345299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123345300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123345300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:48.429089 run osmo-msc_10.42.42.6(pid=8439): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8439)] 12:33:48.476562 run osmo-msc_10.42.42.6(pid=8439): stdout: | (launched: 2022-12-10_12:33:47.358441) 12:33:48.525556 run osmo-msc_10.42.42.6(pid=8439): stderr: | 20221210123347628 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123347628 DLGLOBAL DEBUG validating counter group 0x7f5e60dbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123347628 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123347628 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123347628 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123347629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123347630 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123347631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123347631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123347631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:48.575211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8432): Terminating (SIGTERM) 12:33:48.614733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8435): Terminating (SIGTERM) 12:33:48.654447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8438): Terminating (SIGTERM) 12:33:48.694887 --- ParallelTerminationStrategy: PID 8432 died... 12:33:48.713811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8432): Terminated: ok {rc=0} 12:33:48.758002 --- ParallelTerminationStrategy: PID 8435 died... 12:33:48.776314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8435): Terminated: ok {rc=0} 12:33:48.820331 --- ParallelTerminationStrategy: PID 8438 died... 12:33:48.838900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8438): Terminated: ok {rc=0} 12:33:48.924189 bus /sierra_3: Setting Powered False 12:33:50.024154 bus /sierra_3: Setting Powered False 12:33:51.138925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 12:33:52.395004 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:52.399900 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:33:52.436335 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:33:52.462733 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:33:52.514595 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:33:52.550932 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:33:52.576787 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:33:53.124669 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 12:33:53.129822 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:33:53.140272 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:33:53.174652 tst handover.py: using LAC 28423 12:33:53.293530 tst handover.py: using RAC 118 12:33:53.424407 tst handover.py: using CellId 28423 12:33:53.550519 tst handover.py: using BVCI 28424 12:33:53.667431 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:33:53.700663 tst handover.py: using LAC 28424 12:33:53.825844 tst handover.py: using RAC 119 12:33:53.950195 tst handover.py: using CellId 28424 12:33:54.071359 tst handover.py: using BVCI 28425 12:33:54.180923 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:33:54.192007 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:33:54.202673 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:33:54.213982 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:33:54.225357 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:33:54.236590 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:33:54.354611 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:33:54.472240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:54.911161 run create_hlr_db(pid=8444): Launched 12:33:55.025385 bus /sierra_2: Setting Powered False 12:33:56.085547 run create_hlr_db(pid=8444): Terminated: ok {rc=0} 12:33:56.497264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8446): Launched 12:33:56.818619 run osmo-hlr_10.42.42.2(pid=8447): Launched 12:33:56.941823 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:57.466176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8449): Launched 12:33:57.786345 run osmo-stp_10.42.42.5(pid=8450): Launched 12:33:57.909902 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:58.462017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8452): Launched 12:33:58.782719 run osmo-msc_10.42.42.6(pid=8453): Launched 12:33:58.962025 run osmo-stp_10.42.42.5(pid=8450): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8450)] 12:33:59.096881 run osmo-stp_10.42.42.5(pid=8450): stdout: | (launched: 2022-12-10_12:33:57.728492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:59.231674 run osmo-stp_10.42.42.5(pid=8450): stderr: | 20221210123357919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123357919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123357919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123357920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123357920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123357920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123357920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:59.366163 run osmo-stp_10.42.42.5(pid=8450): stdout: | (launched: 2022-12-10_12:33:57.728492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:59.494262 run osmo-stp_10.42.42.5(pid=8450): stderr: | 20221210123357919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123357919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123357919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123357920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123357920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123357920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123357920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:59.647399 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8450): Process ended prematurely: osmo-stp_10.42.42.5(pid=8450) [trial-2374↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8450)] [trial-2374↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 12:33:59.656294 tst handover.py:18: Test FAILED (6.5 sec) 12:33:59.683627 run osmo-hlr_10.42.42.2(pid=8447): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8447)] 12:33:59.733104 run osmo-hlr_10.42.42.2(pid=8447): stdout: | (launched: 2022-12-10_12:33:56.760546) 12:33:59.784482 run osmo-hlr_10.42.42.2(pid=8447): stderr: | 20221210123356959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123356959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123356959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123356959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123356959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123356959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123356971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123356979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123356979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123356979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:59.856347 run osmo-msc_10.42.42.6(pid=8453): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8453)] 12:33:59.906021 run osmo-msc_10.42.42.6(pid=8453): stdout: | (launched: 2022-12-10_12:33:58.724586) 12:33:59.957227 run osmo-msc_10.42.42.6(pid=8453): stderr: | 20221210123359043 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123359043 DLGLOBAL DEBUG validating counter group 0x7feb42458c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123359043 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123359043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123359043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123359043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123359045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123359046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123359046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123359046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:00.009362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8446): Terminating (SIGTERM) 12:34:00.050900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8449): Terminating (SIGTERM) 12:34:00.092182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8452): Terminating (SIGTERM) 12:34:00.133793 --- ParallelTerminationStrategy: PID 8446 died... 12:34:00.153568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8446): Terminated: ok {rc=0} 12:34:00.199346 --- ParallelTerminationStrategy: PID 8449 died... 12:34:00.218722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8449): Terminated: ok {rc=0} 12:34:00.264340 --- ParallelTerminationStrategy: PID 8452 died... 12:34:00.283803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8452): Terminated: ok {rc=0} 12:34:00.369931 bus /sierra_3: Setting Powered False 12:34:01.475364 bus /sierra_3: Setting Powered False 12:34:02.600636 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 12:34:03.839888 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:03.845300 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:34:03.896691 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:34:03.923763 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:34:03.977730 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:34:04.029161 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:34:04.055963 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:34:04.604863 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 12:34:04.610192 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:34:04.621276 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:34:04.655479 tst handover.py: using LAC 28425 12:34:04.781460 tst handover.py: using RAC 120 12:34:04.908636 tst handover.py: using CellId 28425 12:34:05.026629 tst handover.py: using BVCI 28426 12:34:05.136737 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:34:05.184589 tst handover.py: using LAC 28426 12:34:05.303206 tst handover.py: using RAC 121 12:34:05.421379 tst handover.py: using CellId 28426 12:34:05.537102 tst handover.py: using BVCI 28427 12:34:05.644896 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:34:05.655538 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:34:05.666010 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:34:05.677298 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:34:05.688043 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:34:05.698692 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:34:05.815403 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:34:05.930989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:06.370636 run create_hlr_db(pid=8458): Launched 12:34:06.484906 bus /sierra_2: Setting Powered False 12:34:07.543675 run create_hlr_db(pid=8458): Terminated: ok {rc=0} 12:34:07.936723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8460): Launched 12:34:08.236507 run osmo-hlr_10.42.42.2(pid=8461): Launched 12:34:08.351721 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:08.851862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8463): Launched 12:34:09.152084 run osmo-stp_10.42.42.5(pid=8464): Launched 12:34:09.267619 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:09.784318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8466): Launched 12:34:10.086200 run osmo-msc_10.42.42.6(pid=8467): Launched 12:34:10.255572 run osmo-stp_10.42.42.5(pid=8464): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8464)] 12:34:10.382647 run osmo-stp_10.42.42.5(pid=8464): stdout: | (launched: 2022-12-10_12:34:09.097221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:10.509651 run osmo-stp_10.42.42.5(pid=8464): stderr: | 20221210123409266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123409267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123409267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123409267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123409268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123409268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123409268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:10.634514 run osmo-stp_10.42.42.5(pid=8464): stdout: | (launched: 2022-12-10_12:34:09.097221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:10.754533 run osmo-stp_10.42.42.5(pid=8464): stderr: | 20221210123409266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123409267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123409267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123409267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123409268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123409268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123409268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:10.898214 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8464): Process ended prematurely: osmo-stp_10.42.42.5(pid=8464) [trial-2374↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8464)] [trial-2374↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 12:34:10.906477 tst handover.py:18: Test FAILED (6.3 sec) 12:34:10.932833 run osmo-hlr_10.42.42.2(pid=8461): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8461)] 12:34:10.980307 run osmo-hlr_10.42.42.2(pid=8461): stdout: | (launched: 2022-12-10_12:34:08.182056) 12:34:11.029621 run osmo-hlr_10.42.42.2(pid=8461): stderr: | 20221210123408356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123408356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123408356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123408356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123408356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123408356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123408368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123408376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123408377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123408377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:11.098015 run osmo-msc_10.42.42.6(pid=8467): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8467)] 12:34:11.145487 run osmo-msc_10.42.42.6(pid=8467): stdout: | (launched: 2022-12-10_12:34:10.031391) 12:34:11.194495 run osmo-msc_10.42.42.6(pid=8467): stderr: | 20221210123410299 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123410299 DLGLOBAL DEBUG validating counter group 0x7fbf5f1a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123410299 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123410299 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123410299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123410299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123410301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123410301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123410302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123410302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:11.244159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8460): Terminating (SIGTERM) 12:34:11.283682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8463): Terminating (SIGTERM) 12:34:11.323260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8466): Terminating (SIGTERM) 12:34:11.363278 --- ParallelTerminationStrategy: PID 8460 died... 12:34:11.382162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8460): Terminated: ok {rc=0} 12:34:11.426224 --- ParallelTerminationStrategy: PID 8463 died... 12:34:11.444562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8463): Terminated: ok {rc=0} 12:34:11.488523 --- ParallelTerminationStrategy: PID 8466 died... 12:34:11.506932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8466): Terminated: ok {rc=0} 12:34:11.592107 bus /sierra_3: Setting Powered False 12:34:12.691769 bus /sierra_3: Setting Powered False 12:34:13.805933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:34:15.062821 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:15.068283 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:34:15.115297 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:34:15.142299 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:34:15.196069 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:34:15.243080 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:34:15.270002 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:34:15.821863 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:34:15.827305 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:34:15.855324 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:34:15.891522 tst handover.py: using LAC 28427 12:34:16.024166 tst handover.py: using RAC 122 12:34:16.145297 tst handover.py: using CellId 28427 12:34:16.277156 tst handover.py: using BVCI 28428 12:34:16.434548 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:34:16.481304 tst handover.py: using LAC 28428 12:34:16.627793 tst handover.py: using RAC 123 12:34:16.758675 tst handover.py: using CellId 28428 12:34:16.897789 tst handover.py: using BVCI 28429 12:34:17.017755 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:34:17.030312 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:34:17.042518 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:34:17.054971 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:34:17.068158 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:34:17.081046 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:34:17.204495 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:34:17.324895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:17.797079 run create_hlr_db(pid=8472): Launched 12:34:17.928437 bus /sierra_2: Setting Powered False 12:34:18.993090 run create_hlr_db(pid=8472): Terminated: ok {rc=0} 12:34:19.396744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8474): Launched 12:34:19.697101 run osmo-hlr_10.42.42.2(pid=8475): Launched 12:34:19.812752 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:20.308115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8477): Launched 12:34:20.609056 run osmo-stp_10.42.42.5(pid=8478): Launched 12:34:20.724617 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:21.242010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8480): Launched 12:34:21.541515 run osmo-msc_10.42.42.6(pid=8481): Launched 12:34:21.710411 run osmo-stp_10.42.42.5(pid=8478): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8478)] 12:34:21.837251 run osmo-stp_10.42.42.5(pid=8478): stdout: | (launched: 2022-12-10_12:34:20.554368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:21.963884 run osmo-stp_10.42.42.5(pid=8478): stderr: | 20221210123420725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123420725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123420725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123420726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123420726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123420726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123420726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:22.088693 run osmo-stp_10.42.42.5(pid=8478): stdout: | (launched: 2022-12-10_12:34:20.554368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:22.208380 run osmo-stp_10.42.42.5(pid=8478): stderr: | 20221210123420725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123420725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123420725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123420726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123420726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123420726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123420726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:22.351273 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8478): Process ended prematurely: osmo-stp_10.42.42.5(pid=8478) [trial-2374↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8478)] [trial-2374↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 12:34:22.359544 tst handover.py:18: Test FAILED (6.5 sec) 12:34:22.385715 run osmo-hlr_10.42.42.2(pid=8475): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8475)] 12:34:22.433554 run osmo-hlr_10.42.42.2(pid=8475): stdout: | (launched: 2022-12-10_12:34:19.642175) 12:34:22.482983 run osmo-hlr_10.42.42.2(pid=8475): stderr: | 20221210123419815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123419816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123419816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123419816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123419816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123419816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123419828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123419837 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123419837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123419837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:22.551751 run osmo-msc_10.42.42.6(pid=8481): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8481)] 12:34:22.599336 run osmo-msc_10.42.42.6(pid=8481): stdout: | (launched: 2022-12-10_12:34:21.486914) 12:34:22.648931 run osmo-msc_10.42.42.6(pid=8481): stderr: | 20221210123421757 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123421757 DLGLOBAL DEBUG validating counter group 0x7f78e8658c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123421757 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123421757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123421757 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123421757 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123421759 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123421759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123421760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123421760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:22.698559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8474): Terminating (SIGTERM) 12:34:22.738120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8477): Terminating (SIGTERM) 12:34:22.777793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8480): Terminating (SIGTERM) 12:34:22.817739 --- ParallelTerminationStrategy: PID 8474 died... 12:34:22.836678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8474): Terminated: ok {rc=0} 12:34:22.880724 --- ParallelTerminationStrategy: PID 8477 died... 12:34:22.899095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8477): Terminated: ok {rc=0} 12:34:22.943094 --- ParallelTerminationStrategy: PID 8480 died... 12:34:22.961467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8480): Terminated: ok {rc=0} 12:34:23.047205 bus /sierra_3: Setting Powered False 12:34:24.145228 bus /sierra_3: Setting Powered False 12:34:25.259559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:34:26.511553 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:26.516899 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:34:26.568048 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:34:26.594131 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:34:26.649465 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:34:26.699658 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:34:26.725679 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:34:27.276128 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:34:27.281915 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:34:27.293397 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:34:27.330197 tst handover.py: using LAC 28429 12:34:27.454588 tst handover.py: using RAC 124 12:34:27.579178 tst handover.py: using CellId 28429 12:34:27.704925 tst handover.py: using BVCI 28430 12:34:27.820881 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:34:27.869283 tst handover.py: using LAC 28430 12:34:27.993759 tst handover.py: using RAC 125 12:34:28.119569 tst handover.py: using CellId 28430 12:34:28.243406 tst handover.py: using BVCI 28431 12:34:28.360008 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:34:28.371499 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:34:28.382853 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:34:28.394078 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:34:28.405440 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:34:28.416580 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:34:28.531277 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:34:28.643154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:29.083871 run create_hlr_db(pid=8486): Launched 12:34:29.199873 bus /sierra_2: Setting Powered False 12:34:30.260491 run create_hlr_db(pid=8486): Terminated: ok {rc=0} 12:34:30.672742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8488): Launched 12:34:31.013487 run osmo-hlr_10.42.42.2(pid=8489): Launched 12:34:31.237712 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:31.981267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8491): Launched 12:34:32.417944 run osmo-stp_10.42.42.5(pid=8492): Launched 12:34:32.559148 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:33.077875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8494): Launched 12:34:33.376909 run osmo-msc_10.42.42.6(pid=8495): Launched 12:34:33.545956 run osmo-stp_10.42.42.5(pid=8492): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8492)] 12:34:33.674311 run osmo-stp_10.42.42.5(pid=8492): stdout: | (launched: 2022-12-10_12:34:32.347051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:33.801529 run osmo-stp_10.42.42.5(pid=8492): stderr: | 20221210123432575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123432575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123432575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123432576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123432576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123432576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123432576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:33.925682 run osmo-stp_10.42.42.5(pid=8492): stdout: | (launched: 2022-12-10_12:34:32.347051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:34.045307 run osmo-stp_10.42.42.5(pid=8492): stderr: | 20221210123432575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123432575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123432575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123432576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123432576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123432576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123432576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:34.188757 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8492): Process ended prematurely: osmo-stp_10.42.42.5(pid=8492) [trial-2374↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8492)] [trial-2374↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 12:34:34.197013 tst handover.py:18: Test FAILED (6.9 sec) 12:34:34.223148 run osmo-hlr_10.42.42.2(pid=8489): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8489)] 12:34:34.271065 run osmo-hlr_10.42.42.2(pid=8489): stdout: | (launched: 2022-12-10_12:34:30.944345) 12:34:34.320393 run osmo-hlr_10.42.42.2(pid=8489): stderr: | 20221210123431401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123431401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123431401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123431401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123431401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123431401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123431427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123431454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123431454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123431454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:34.389493 run osmo-msc_10.42.42.6(pid=8495): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8495)] 12:34:34.437412 run osmo-msc_10.42.42.6(pid=8495): stdout: | (launched: 2022-12-10_12:34:33.322588) 12:34:34.487064 run osmo-msc_10.42.42.6(pid=8495): stderr: | 20221210123433592 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123433592 DLGLOBAL DEBUG validating counter group 0x7fa7ebc67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123433592 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123433592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123433592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123433593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123433594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123433595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123433595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123433595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:34.537158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8488): Terminating (SIGTERM) 12:34:34.577106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8491): Terminating (SIGTERM) 12:34:34.617036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8494): Terminating (SIGTERM) 12:34:34.657103 --- ParallelTerminationStrategy: PID 8488 died... 12:34:34.675988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8488): Terminated: ok {rc=0} 12:34:34.720144 --- ParallelTerminationStrategy: PID 8491 died... 12:34:34.738712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8491): Terminated: ok {rc=0} 12:34:34.782994 --- ParallelTerminationStrategy: PID 8494 died... 12:34:34.801544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8494): Terminated: ok {rc=0} 12:34:34.887746 bus /sierra_3: Setting Powered False 12:34:35.988200 bus /sierra_3: Setting Powered False 12:34:37.103628 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 12:34:38.360747 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:38.366203 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:34:38.404997 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:34:38.432005 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:34:38.489476 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:34:38.528017 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:34:38.554859 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:34:39.096540 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 12:34:39.102108 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:34:39.112809 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:34:39.147426 tst handover.py: using LAC 28431 12:34:39.263371 tst handover.py: using RAC 126 12:34:39.380038 tst handover.py: using CellId 28431 12:34:39.496148 tst handover.py: using BVCI 28432 12:34:39.604725 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:34:39.637800 tst handover.py: using LAC 28432 12:34:39.763563 tst handover.py: using RAC 127 12:34:39.889117 tst handover.py: using CellId 28432 12:34:40.014657 tst handover.py: using BVCI 28433 12:34:40.131821 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:34:40.143157 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:34:40.154294 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:34:40.165954 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:34:40.177471 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:34:40.188829 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:34:40.303688 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:34:40.422293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:40.895323 run create_hlr_db(pid=8500): Launched 12:34:41.026197 bus /sierra_2: Setting Powered False 12:34:42.090016 run create_hlr_db(pid=8500): Terminated: ok {rc=0} 12:34:42.494861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8502): Launched 12:34:42.796691 run osmo-hlr_10.42.42.2(pid=8503): Launched 12:34:42.911945 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:43.418744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8505): Launched 12:34:43.719471 run osmo-stp_10.42.42.5(pid=8506): Launched 12:34:43.834917 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:44.356571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8508): Launched 12:34:44.657377 run osmo-msc_10.42.42.6(pid=8509): Launched 12:34:44.826701 run osmo-stp_10.42.42.5(pid=8506): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8506)] 12:34:44.954357 run osmo-stp_10.42.42.5(pid=8506): stdout: | (launched: 2022-12-10_12:34:43.664662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:45.082024 run osmo-stp_10.42.42.5(pid=8506): stderr: | 20221210123443836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123443836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123443837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123443837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123443838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123443838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123443838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:45.208094 run osmo-stp_10.42.42.5(pid=8506): stdout: | (launched: 2022-12-10_12:34:43.664662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:45.328684 run osmo-stp_10.42.42.5(pid=8506): stderr: | 20221210123443836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123443836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123443837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123443837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123443838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123443838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123443838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:45.473082 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8506): Process ended prematurely: osmo-stp_10.42.42.5(pid=8506) [trial-2374↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8506)] [trial-2374↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 12:34:45.481526 tst handover.py:18: Test FAILED (6.4 sec) 12:34:45.508922 run osmo-hlr_10.42.42.2(pid=8503): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8503)] 12:34:45.558240 run osmo-hlr_10.42.42.2(pid=8503): stdout: | (launched: 2022-12-10_12:34:42.741836) 12:34:45.608881 run osmo-hlr_10.42.42.2(pid=8503): stderr: | 20221210123442918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123442918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123442919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123442919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123442919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123442919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123442931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123442940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123442940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123442940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:45.679094 run osmo-msc_10.42.42.6(pid=8509): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8509)] 12:34:45.727754 run osmo-msc_10.42.42.6(pid=8509): stdout: | (launched: 2022-12-10_12:34:44.602662) 12:34:45.778128 run osmo-msc_10.42.42.6(pid=8509): stderr: | 20221210123444874 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123444874 DLGLOBAL DEBUG validating counter group 0x7f81a3271c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123444874 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123444874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123444874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123444874 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123444878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123444879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123444879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123444879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:45.829560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8502): Terminating (SIGTERM) 12:34:45.885369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8505): Terminating (SIGTERM) 12:34:45.927195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8508): Terminating (SIGTERM) 12:34:45.981320 --- ParallelTerminationStrategy: PID 8502 died... 12:34:46.002631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8502): Terminated: ok {rc=0} 12:34:46.055161 --- ParallelTerminationStrategy: PID 8505 died... 12:34:46.077409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8505): Terminated: ok {rc=0} 12:34:46.126478 --- ParallelTerminationStrategy: PID 8508 died... 12:34:46.147591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8508): Terminated: ok {rc=0} 12:34:46.239672 bus /sierra_3: Setting Powered False 12:34:47.340557 bus /sierra_3: Setting Powered False 12:34:48.457085 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 12:34:49.700448 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:49.705960 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:34:49.756823 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:34:49.783851 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:34:49.836262 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:34:49.886948 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:34:49.913606 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:34:50.468629 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 12:34:50.474147 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:34:50.485265 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:34:50.522825 tst handover.py: using LAC 28433 12:34:50.646749 tst handover.py: using RAC 128 12:34:50.770154 tst handover.py: using CellId 28433 12:34:50.894270 tst handover.py: using BVCI 28434 12:34:51.011313 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:34:51.059440 tst handover.py: using LAC 28434 12:34:51.185109 tst handover.py: using RAC 129 12:34:51.315370 tst handover.py: using CellId 28434 12:34:51.441149 tst handover.py: using BVCI 28435 12:34:51.557587 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:34:51.569031 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:34:51.580053 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:34:51.591043 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:34:51.602164 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:34:51.613046 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:34:51.728696 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:34:51.846445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:52.317473 run create_hlr_db(pid=8514): Launched 12:34:52.447324 bus /sierra_2: Setting Powered False 12:34:53.510910 run create_hlr_db(pid=8514): Terminated: ok {rc=0} 12:34:53.931332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8516): Launched 12:34:54.253091 run osmo-hlr_10.42.42.2(pid=8517): Launched 12:34:54.376829 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:54.870608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8519): Launched 12:34:55.170428 run osmo-stp_10.42.42.5(pid=8520): Launched 12:34:55.285902 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:55.803212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8522): Launched 12:34:56.102458 run osmo-msc_10.42.42.6(pid=8523): Launched 12:34:56.271921 run osmo-stp_10.42.42.5(pid=8520): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8520)] 12:34:56.399281 run osmo-stp_10.42.42.5(pid=8520): stdout: | (launched: 2022-12-10_12:34:55.115917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:56.526208 run osmo-stp_10.42.42.5(pid=8520): stderr: | 20221210123455284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123455284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123455285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123455285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123455286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123455286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123455286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:56.651177 run osmo-stp_10.42.42.5(pid=8520): stdout: | (launched: 2022-12-10_12:34:55.115917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:56.771315 run osmo-stp_10.42.42.5(pid=8520): stderr: | 20221210123455284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123455284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123455285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123455285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123455286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123455286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123455286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:56.914810 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8520): Process ended prematurely: osmo-stp_10.42.42.5(pid=8520) [trial-2374↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8520)] [trial-2374↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 12:34:56.923179 tst handover.py:18: Test FAILED (6.4 sec) 12:34:56.949512 run osmo-hlr_10.42.42.2(pid=8517): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8517)] 12:34:56.997397 run osmo-hlr_10.42.42.2(pid=8517): stdout: | (launched: 2022-12-10_12:34:54.194614) 12:34:57.046593 run osmo-hlr_10.42.42.2(pid=8517): stderr: | 20221210123454394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123454394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123454394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123454394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123454394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123454394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123454406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123454414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123454414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123454414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:57.114901 run osmo-msc_10.42.42.6(pid=8523): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8523)] 12:34:57.162364 run osmo-msc_10.42.42.6(pid=8523): stdout: | (launched: 2022-12-10_12:34:56.047961) 12:34:57.211589 run osmo-msc_10.42.42.6(pid=8523): stderr: | 20221210123456316 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123456317 DLGLOBAL DEBUG validating counter group 0x7fb0969c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123456317 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123456317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123456317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123456317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123456319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123456319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123456319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123456320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:57.261285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8516): Terminating (SIGTERM) 12:34:57.300657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8519): Terminating (SIGTERM) 12:34:57.340494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8522): Terminating (SIGTERM) 12:34:57.381093 --- ParallelTerminationStrategy: PID 8516 died... 12:34:57.400059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8516): Terminated: ok {rc=0} 12:34:57.444813 --- ParallelTerminationStrategy: PID 8519 died... 12:34:57.463471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8519): Terminated: ok {rc=0} 12:34:57.508039 --- ParallelTerminationStrategy: PID 8522 died... 12:34:57.526809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8522): Terminated: ok {rc=0} 12:34:57.613633 bus /sierra_3: Setting Powered False 12:34:58.711810 bus /sierra_3: Setting Powered False 12:34:59.823827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 12:35:01.091962 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:01.099042 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:35:01.150578 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:35:01.178175 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:35:01.234006 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:35:01.303983 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:35:01.332924 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:35:01.895514 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 12:35:01.902439 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:35:01.914645 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:35:01.953120 tst handover.py: using LAC 28435 12:35:02.081872 tst handover.py: using RAC 130 12:35:02.223704 tst handover.py: using CellId 28435 12:35:02.343375 tst handover.py: using BVCI 28436 12:35:02.452335 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:35:02.499685 tst handover.py: using LAC 28436 12:35:02.618385 tst handover.py: using RAC 131 12:35:02.735877 tst handover.py: using CellId 28436 12:35:02.853567 tst handover.py: using BVCI 28437 12:35:02.971116 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:35:02.982605 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:35:02.993846 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:35:03.005619 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:35:03.016809 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:35:03.028011 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:35:03.145622 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:35:03.260481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:03.700713 run create_hlr_db(pid=8531): Launched 12:35:03.815863 bus /sierra_2: Setting Powered False 12:35:04.876837 run create_hlr_db(pid=8531): Terminated: ok {rc=0} 12:35:05.270424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8533): Launched 12:35:05.569963 run osmo-hlr_10.42.42.2(pid=8534): Launched 12:35:05.684642 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:06.190751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8536): Launched 12:35:06.490305 run osmo-stp_10.42.42.5(pid=8537): Launched 12:35:06.605122 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:07.125304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8539): Launched 12:35:07.425436 run osmo-msc_10.42.42.6(pid=8540): Launched 12:35:07.594370 run osmo-stp_10.42.42.5(pid=8537): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8537)] 12:35:07.721498 run osmo-stp_10.42.42.5(pid=8537): stdout: | (launched: 2022-12-10_12:35:06.435956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:07.848817 run osmo-stp_10.42.42.5(pid=8537): stderr: | 20221210123506603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123506604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123506604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123506604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123506605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123506605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123506605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:07.974294 run osmo-stp_10.42.42.5(pid=8537): stdout: | (launched: 2022-12-10_12:35:06.435956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:08.094196 run osmo-stp_10.42.42.5(pid=8537): stderr: | 20221210123506603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123506604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123506604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123506604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123506605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123506605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123506605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:08.237512 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8537): Process ended prematurely: osmo-stp_10.42.42.5(pid=8537) [trial-2374↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8537)] [trial-2374↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 12:35:08.245669 tst handover.py:18: Test FAILED (6.3 sec) 12:35:08.271691 run osmo-hlr_10.42.42.2(pid=8534): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8534)] 12:35:08.319778 run osmo-hlr_10.42.42.2(pid=8534): stdout: | (launched: 2022-12-10_12:35:05.515399) 12:35:08.369080 run osmo-hlr_10.42.42.2(pid=8534): stderr: | 20221210123505693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123505693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123505693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123505693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123505693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123505693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123505704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123505713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123505713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123505713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:08.437754 run osmo-msc_10.42.42.6(pid=8540): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8540)] 12:35:08.485288 run osmo-msc_10.42.42.6(pid=8540): stdout: | (launched: 2022-12-10_12:35:07.370612) 12:35:08.534361 run osmo-msc_10.42.42.6(pid=8540): stderr: | 20221210123507638 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123507638 DLGLOBAL DEBUG validating counter group 0x7f549bb7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123507639 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123507639 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123507639 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123507639 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123507641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123507641 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123507641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123507641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:08.583796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8533): Terminating (SIGTERM) 12:35:08.623340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8536): Terminating (SIGTERM) 12:35:08.663010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8539): Terminating (SIGTERM) 12:35:08.702763 --- ParallelTerminationStrategy: PID 8533 died... 12:35:08.721628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8533): Terminated: ok {rc=0} 12:35:08.766025 --- ParallelTerminationStrategy: PID 8536 died... 12:35:08.784294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8536): Terminated: ok {rc=0} 12:35:08.828887 --- ParallelTerminationStrategy: PID 8539 died... 12:35:08.847601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8539): Terminated: ok {rc=0} 12:35:08.932128 bus /sierra_3: Setting Powered False 12:35:10.030705 bus /sierra_3: Setting Powered False 12:35:11.147575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 12:35:12.409192 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:12.414820 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:35:12.465137 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:35:12.492425 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:35:12.545693 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:35:12.595193 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:35:12.622464 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:35:13.173822 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 12:35:13.179421 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:35:13.190753 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:35:13.224494 tst handover.py: using LAC 28437 12:35:13.350440 tst handover.py: using RAC 132 12:35:13.475850 tst handover.py: using CellId 28437 12:35:13.595328 tst handover.py: using BVCI 28438 12:35:13.705388 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:35:13.752825 tst handover.py: using LAC 28438 12:35:13.871629 tst handover.py: using RAC 133 12:35:13.998237 tst handover.py: using CellId 28438 12:35:14.122921 tst handover.py: using BVCI 28439 12:35:14.232409 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:35:14.243244 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:35:14.253831 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:35:14.264540 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:35:14.275318 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:35:14.286123 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:35:14.402498 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:35:14.522142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:14.960594 run create_hlr_db(pid=8545): Launched 12:35:15.074770 bus /sierra_2: Setting Powered False 12:35:16.145299 run create_hlr_db(pid=8545): Terminated: ok {rc=0} 12:35:16.578121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8547): Launched 12:35:16.925667 run osmo-hlr_10.42.42.2(pid=8548): Launched 12:35:17.081786 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:17.646173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8550): Launched 12:35:17.966759 run osmo-stp_10.42.42.5(pid=8551): Launched 12:35:18.090067 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:18.645348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8553): Launched 12:35:18.967572 run osmo-msc_10.42.42.6(pid=8554): Launched 12:35:19.148222 run osmo-stp_10.42.42.5(pid=8551): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8551)] 12:35:19.283383 run osmo-stp_10.42.42.5(pid=8551): stdout: | (launched: 2022-12-10_12:35:17.908897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:19.419194 run osmo-stp_10.42.42.5(pid=8551): stderr: | 20221210123518102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123518102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123518102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123518102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123518103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123518103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123518103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:19.554585 run osmo-stp_10.42.42.5(pid=8551): stdout: | (launched: 2022-12-10_12:35:17.908897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:19.683568 run osmo-stp_10.42.42.5(pid=8551): stderr: | 20221210123518102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123518102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123518102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123518102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123518103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123518103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123518103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:19.837814 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8551): Process ended prematurely: osmo-stp_10.42.42.5(pid=8551) [trial-2374↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8551)] [trial-2374↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 12:35:19.846867 tst handover.py:18: Test FAILED (6.7 sec) 12:35:19.874288 run osmo-hlr_10.42.42.2(pid=8548): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8548)] 12:35:19.924217 run osmo-hlr_10.42.42.2(pid=8548): stdout: | (launched: 2022-12-10_12:35:16.853141) 12:35:19.975766 run osmo-hlr_10.42.42.2(pid=8548): stderr: | 20221210123517183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123517183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123517183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123517183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123517183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123517183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123517202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123517210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123517211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123517211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:20.048215 run osmo-msc_10.42.42.6(pid=8554): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8554)] 12:35:20.098297 run osmo-msc_10.42.42.6(pid=8554): stdout: | (launched: 2022-12-10_12:35:18.909264) 12:35:20.149412 run osmo-msc_10.42.42.6(pid=8554): stderr: | 20221210123519229 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123519229 DLGLOBAL DEBUG validating counter group 0x7fe9f60b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123519229 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123519229 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123519229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123519230 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123519231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123519232 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123519232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123519232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:20.200876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8547): Terminating (SIGTERM) 12:35:20.242476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8550): Terminating (SIGTERM) 12:35:20.283943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8553): Terminating (SIGTERM) 12:35:20.326163 --- ParallelTerminationStrategy: PID 8547 died... 12:35:20.346023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8547): Terminated: ok {rc=0} 12:35:20.392148 --- ParallelTerminationStrategy: PID 8550 died... 12:35:20.411699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8550): Terminated: ok {rc=0} 12:35:20.457896 --- ParallelTerminationStrategy: PID 8553 died... 12:35:20.477456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8553): Terminated: ok {rc=0} 12:35:20.565575 bus /sierra_3: Setting Powered False 12:35:21.663989 bus /sierra_3: Setting Powered False 12:35:22.781345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:35:24.033965 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:24.039284 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:35:24.084145 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:35:24.110576 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:35:24.163229 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:35:24.207520 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:35:24.233676 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:35:24.782827 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:35:24.788190 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:35:24.799144 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:35:24.832359 tst handover.py: using LAC 28439 12:35:24.950732 tst handover.py: using RAC 134 12:35:25.069924 tst handover.py: using CellId 28439 12:35:25.189040 tst handover.py: using BVCI 28440 12:35:25.299398 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:35:25.343519 tst handover.py: using LAC 28440 12:35:25.462339 tst handover.py: using RAC 135 12:35:25.579309 tst handover.py: using CellId 28440 12:35:25.698986 tst handover.py: using BVCI 28441 12:35:25.807195 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:35:25.818269 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:35:25.829130 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:35:25.840074 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:35:25.851009 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:35:25.862093 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:35:25.974732 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:35:26.093923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:26.566467 run create_hlr_db(pid=8559): Launched 12:35:26.697818 bus /sierra_2: Setting Powered False 12:35:27.761774 run create_hlr_db(pid=8559): Terminated: ok {rc=0} 12:35:28.165151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8561): Launched 12:35:28.466532 run osmo-hlr_10.42.42.2(pid=8562): Launched 12:35:28.583794 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:29.074800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Launched 12:35:29.374687 run osmo-stp_10.42.42.5(pid=8566): Launched 12:35:29.488766 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:30.004824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8568): Launched 12:35:30.305638 run osmo-msc_10.42.42.6(pid=8569): Launched 12:35:30.473661 run osmo-stp_10.42.42.5(pid=8566): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8566)] 12:35:30.601838 run osmo-stp_10.42.42.5(pid=8566): stdout: | (launched: 2022-12-10_12:35:29.319923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:30.728611 run osmo-stp_10.42.42.5(pid=8566): stderr: | 20221210123529489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123529489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123529489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123529490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123529492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123529492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123529492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:30.874131 run osmo-stp_10.42.42.5(pid=8566): stdout: | (launched: 2022-12-10_12:35:29.319923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:31.034318 run osmo-stp_10.42.42.5(pid=8566): stderr: | 20221210123529489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123529489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123529489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123529490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123529492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123529492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123529492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:31.211091 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8566): Process ended prematurely: osmo-stp_10.42.42.5(pid=8566) [trial-2374↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8566)] [trial-2374↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 12:35:31.221496 tst handover.py:18: Test FAILED (6.4 sec) 12:35:31.250882 run osmo-hlr_10.42.42.2(pid=8562): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8562)] 12:35:31.303403 run osmo-hlr_10.42.42.2(pid=8562): stdout: | (launched: 2022-12-10_12:35:28.411594) 12:35:31.356786 run osmo-hlr_10.42.42.2(pid=8562): stderr: | 20221210123528586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123528586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123528586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123528586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123528586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123528586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123528598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123528607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123528607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123528607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:31.430489 run osmo-msc_10.42.42.6(pid=8569): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8569)] 12:35:31.483213 run osmo-msc_10.42.42.6(pid=8569): stdout: | (launched: 2022-12-10_12:35:30.250652) 12:35:31.536411 run osmo-msc_10.42.42.6(pid=8569): stderr: | 20221210123530520 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123530520 DLGLOBAL DEBUG validating counter group 0x7f14fc6d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123530520 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123530520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123530521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123530521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123530522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123530523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123530523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123530523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:31.590626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8561): Terminating (SIGTERM) 12:35:31.633911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Terminating (SIGTERM) 12:35:31.679195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8568): Terminating (SIGTERM) 12:35:31.725497 --- ParallelTerminationStrategy: PID 8561 died... 12:35:31.746588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8561): Terminated: ok {rc=0} 12:35:31.795560 --- ParallelTerminationStrategy: PID 8565 died... 12:35:31.815968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Terminated: ok {rc=0} 12:35:31.864302 --- ParallelTerminationStrategy: PID 8568 died... 12:35:31.885396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8568): Terminated: ok {rc=0} 12:35:31.975499 bus /sierra_3: Setting Powered False 12:35:33.076608 bus /sierra_3: Setting Powered False 12:35:34.191756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:35:35.445250 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:35.450814 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:35:35.501129 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:35:35.528265 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:35:35.582744 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:35:35.633128 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:35:35.659991 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:35:36.211039 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:35:36.216456 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:35:36.227853 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:35:36.262874 tst handover.py: using LAC 28441 12:35:36.391975 tst handover.py: using RAC 136 12:35:36.518053 tst handover.py: using CellId 28441 12:35:36.650350 tst handover.py: using BVCI 28442 12:35:36.768303 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:35:36.817589 tst handover.py: using LAC 28442 12:35:36.937373 tst handover.py: using RAC 137 12:35:37.054780 tst handover.py: using CellId 28442 12:35:37.170711 tst handover.py: using BVCI 28443 12:35:37.279189 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:35:37.290318 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:35:37.301164 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:35:37.312465 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:35:37.323461 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:35:37.334308 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:35:37.451316 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:35:37.567768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:38.007927 run create_hlr_db(pid=8574): Launched 12:35:38.122161 bus /sierra_2: Setting Powered False 12:35:39.182989 run create_hlr_db(pid=8574): Terminated: ok {rc=0} 12:35:39.594212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8576): Launched 12:35:39.915812 run osmo-hlr_10.42.42.2(pid=8577): Launched 12:35:40.039562 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:40.566617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8579): Launched 12:35:40.888257 run osmo-stp_10.42.42.5(pid=8580): Launched 12:35:41.011041 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:41.567800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8582): Launched 12:35:41.889256 run osmo-msc_10.42.42.6(pid=8583): Launched 12:35:42.069430 run osmo-stp_10.42.42.5(pid=8580): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8580)] 12:35:42.204737 run osmo-stp_10.42.42.5(pid=8580): stdout: | (launched: 2022-12-10_12:35:40.829300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:42.340483 run osmo-stp_10.42.42.5(pid=8580): stderr: | 20221210123541022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123541022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123541023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123541023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123541023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123541024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123541024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:42.475513 run osmo-stp_10.42.42.5(pid=8580): stdout: | (launched: 2022-12-10_12:35:40.829300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:42.603861 run osmo-stp_10.42.42.5(pid=8580): stderr: | 20221210123541022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123541022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123541023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123541023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123541023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123541024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123541024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:42.757649 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8580): Process ended prematurely: osmo-stp_10.42.42.5(pid=8580) [trial-2374↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8580)] [trial-2374↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 12:35:42.768164 tst handover.py:18: Test FAILED (6.5 sec) 12:35:42.795545 run osmo-hlr_10.42.42.2(pid=8577): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8577)] 12:35:42.845179 run osmo-hlr_10.42.42.2(pid=8577): stdout: | (launched: 2022-12-10_12:35:39.857779) 12:35:42.896751 run osmo-hlr_10.42.42.2(pid=8577): stderr: | 20221210123540056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123540056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123540056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123540056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123540056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123540057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123540069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123540079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123540079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123540079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:42.968265 run osmo-msc_10.42.42.6(pid=8583): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8583)] 12:35:43.018014 run osmo-msc_10.42.42.6(pid=8583): stdout: | (launched: 2022-12-10_12:35:41.830855) 12:35:43.069544 run osmo-msc_10.42.42.6(pid=8583): stderr: | 20221210123542149 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123542149 DLGLOBAL DEBUG validating counter group 0x7f5963e41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123542149 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123542149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123542149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123542149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123542151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123542151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123542152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123542152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:43.121308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8576): Terminating (SIGTERM) 12:35:43.163041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8579): Terminating (SIGTERM) 12:35:43.204475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8582): Terminating (SIGTERM) 12:35:43.246790 --- ParallelTerminationStrategy: PID 8576 died... 12:35:43.266668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8576): Terminated: ok {rc=0} 12:35:43.312837 --- ParallelTerminationStrategy: PID 8579 died... 12:35:43.332702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8579): Terminated: ok {rc=0} 12:35:43.378525 --- ParallelTerminationStrategy: PID 8582 died... 12:35:43.398420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8582): Terminated: ok {rc=0} 12:35:43.486568 bus /sierra_3: Setting Powered False 12:35:44.583824 bus /sierra_3: Setting Powered False 12:35:45.701642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 12:35:47.025042 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:47.033582 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:35:47.081469 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:35:47.115094 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:35:47.169507 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:35:47.209711 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:35:47.237529 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:35:47.780231 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 12:35:47.786427 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:35:47.798066 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:35:47.831867 tst handover.py: using LAC 28443 12:35:47.952203 tst handover.py: using RAC 138 12:35:48.070708 tst handover.py: using CellId 28443 12:35:48.188511 tst handover.py: using BVCI 28444 12:35:48.297323 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:35:48.337140 tst handover.py: using LAC 28444 12:35:48.454146 tst handover.py: using RAC 139 12:35:48.571397 tst handover.py: using CellId 28444 12:35:48.687642 tst handover.py: using BVCI 28445 12:35:48.796629 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:35:48.807438 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:35:48.818247 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:35:48.829125 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:35:48.839967 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:35:48.850889 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:35:48.969541 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:35:49.084846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:49.525653 run create_hlr_db(pid=8588): Launched 12:35:49.640620 bus /sierra_2: Setting Powered False 12:35:50.700783 run create_hlr_db(pid=8588): Terminated: ok {rc=0} 12:35:51.113696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8590): Launched 12:35:51.435049 run osmo-hlr_10.42.42.2(pid=8591): Launched 12:35:51.560006 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:52.086267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8593): Launched 12:35:52.407786 run osmo-stp_10.42.42.5(pid=8594): Launched 12:35:52.531083 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:53.085562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8596): Launched 12:35:53.387499 run osmo-msc_10.42.42.6(pid=8597): Launched 12:35:53.555998 run osmo-stp_10.42.42.5(pid=8594): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8594)] 12:35:53.691691 run osmo-stp_10.42.42.5(pid=8594): stdout: | (launched: 2022-12-10_12:35:52.349434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:53.821312 run osmo-stp_10.42.42.5(pid=8594): stderr: | 20221210123552540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123552540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123552540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123552540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123552541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123552541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123552541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:53.946456 run osmo-stp_10.42.42.5(pid=8594): stdout: | (launched: 2022-12-10_12:35:52.349434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:54.066592 run osmo-stp_10.42.42.5(pid=8594): stderr: | 20221210123552540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123552540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123552540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123552540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123552541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123552541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123552541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:54.210233 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8594): Process ended prematurely: osmo-stp_10.42.42.5(pid=8594) [trial-2374↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8594)] [trial-2374↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 12:35:54.218546 tst handover.py:18: Test FAILED (6.4 sec) 12:35:54.245159 run osmo-hlr_10.42.42.2(pid=8591): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8591)] 12:35:54.293190 run osmo-hlr_10.42.42.2(pid=8591): stdout: | (launched: 2022-12-10_12:35:51.376891) 12:35:54.342305 run osmo-hlr_10.42.42.2(pid=8591): stderr: | 20221210123551576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123551576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123551576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123551576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123551576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123551576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123551588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123551597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123551597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123551597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:54.411122 run osmo-msc_10.42.42.6(pid=8597): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8597)] 12:35:54.458760 run osmo-msc_10.42.42.6(pid=8597): stdout: | (launched: 2022-12-10_12:35:53.332646) 12:35:54.507932 run osmo-msc_10.42.42.6(pid=8597): stderr: | 20221210123553602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123553602 DLGLOBAL DEBUG validating counter group 0x7fa6d7a20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123553603 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123553603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123553603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123553603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123553605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123553606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123553606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123553606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:54.557663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8590): Terminating (SIGTERM) 12:35:54.597394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8593): Terminating (SIGTERM) 12:35:54.637197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8596): Terminating (SIGTERM) 12:35:54.677378 --- ParallelTerminationStrategy: PID 8590 died... 12:35:54.696413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8590): Terminated: ok {rc=0} 12:35:54.741093 --- ParallelTerminationStrategy: PID 8593 died... 12:35:54.759767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8593): Terminated: ok {rc=0} 12:35:54.803829 --- ParallelTerminationStrategy: PID 8596 died... 12:35:54.822398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8596): Terminated: ok {rc=0} 12:35:54.906550 bus /sierra_3: Setting Powered False 12:35:56.004834 bus /sierra_3: Setting Powered False 12:35:57.121137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 12:35:58.362065 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:58.367720 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:35:58.417629 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:35:58.444495 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:35:58.498910 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:35:58.548346 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:35:58.575308 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:35:59.120451 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 12:35:59.126029 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:35:59.136686 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:35:59.169666 tst handover.py: using LAC 28445 12:35:59.292358 tst handover.py: using RAC 140 12:35:59.423920 tst handover.py: using CellId 28445 12:35:59.549448 tst handover.py: using BVCI 28446 12:35:59.666078 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:35:59.714408 tst handover.py: using LAC 28446 12:35:59.840321 tst handover.py: using RAC 141 12:35:59.966163 tst handover.py: using CellId 28446 12:36:00.090303 tst handover.py: using BVCI 28447 12:36:00.206735 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:00.217921 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:00.228874 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:00.239906 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:00.251003 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:00.261941 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:36:00.375348 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:36:00.489812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:00.979756 run create_hlr_db(pid=8602): Launched 12:36:01.144776 bus /sierra_2: Setting Powered False 12:36:02.207880 run create_hlr_db(pid=8602): Terminated: ok {rc=0} 12:36:02.630357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8604): Launched 12:36:02.953321 run osmo-hlr_10.42.42.2(pid=8605): Launched 12:36:03.077434 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:03.602514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8607): Launched 12:36:03.922918 run osmo-stp_10.42.42.5(pid=8608): Launched 12:36:04.047077 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:04.600300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8610): Launched 12:36:04.923169 run osmo-msc_10.42.42.6(pid=8611): Launched 12:36:05.103857 run osmo-stp_10.42.42.5(pid=8608): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8608)] 12:36:05.239570 run osmo-stp_10.42.42.5(pid=8608): stdout: | (launched: 2022-12-10_12:36:03.864782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:05.375288 run osmo-stp_10.42.42.5(pid=8608): stderr: | 20221210123604056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123604056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123604056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123604057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123604057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123604057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123604057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:05.510639 run osmo-stp_10.42.42.5(pid=8608): stdout: | (launched: 2022-12-10_12:36:03.864782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:05.639331 run osmo-stp_10.42.42.5(pid=8608): stderr: | 20221210123604056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123604056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123604056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123604057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123604057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123604057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123604057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:05.793323 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8608): Process ended prematurely: osmo-stp_10.42.42.5(pid=8608) [trial-2374↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8608)] [trial-2374↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 12:36:05.802151 tst handover.py:18: Test FAILED (6.7 sec) 12:36:05.830547 run osmo-hlr_10.42.42.2(pid=8605): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8605)] 12:36:05.881172 run osmo-hlr_10.42.42.2(pid=8605): stdout: | (launched: 2022-12-10_12:36:02.894822) 12:36:05.933340 run osmo-hlr_10.42.42.2(pid=8605): stderr: | 20221210123603092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123603092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123603093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123603093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123603093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123603093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123603105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123603114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123603114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123603114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:06.006022 run osmo-msc_10.42.42.6(pid=8611): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8611)] 12:36:06.056567 run osmo-msc_10.42.42.6(pid=8611): stdout: | (launched: 2022-12-10_12:36:04.864631) 12:36:06.108261 run osmo-msc_10.42.42.6(pid=8611): stderr: | 20221210123605185 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123605185 DLGLOBAL DEBUG validating counter group 0x7fa10a19fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123605185 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123605185 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123605185 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123605185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123605187 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123605187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123605187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123605188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:06.160293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8604): Terminating (SIGTERM) 12:36:06.201919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8607): Terminating (SIGTERM) 12:36:06.243934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8610): Terminating (SIGTERM) 12:36:06.286113 --- ParallelTerminationStrategy: PID 8604 died... 12:36:06.306109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8604): Terminated: ok {rc=0} 12:36:06.352376 --- ParallelTerminationStrategy: PID 8607 died... 12:36:06.372121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8607): Terminated: ok {rc=0} 12:36:06.418383 --- ParallelTerminationStrategy: PID 8610 died... 12:36:06.438018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8610): Terminated: ok {rc=0} 12:36:06.525129 bus /sierra_3: Setting Powered False 12:36:07.623765 bus /sierra_3: Setting Powered False 12:36:08.737918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 12:36:09.990158 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:09.995318 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:36:10.043660 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:36:10.069984 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:36:10.122574 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:36:10.170231 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:36:10.196642 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:36:10.743783 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 12:36:10.749266 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:36:10.759982 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:36:10.793957 tst handover.py: using LAC 28447 12:36:10.915050 tst handover.py: using RAC 142 12:36:11.036054 tst handover.py: using CellId 28447 12:36:11.155212 tst handover.py: using BVCI 28448 12:36:11.265009 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:36:11.311129 tst handover.py: using LAC 28448 12:36:11.429612 tst handover.py: using RAC 143 12:36:11.556006 tst handover.py: using CellId 28448 12:36:11.680266 tst handover.py: using BVCI 28449 12:36:11.796907 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:36:11.808535 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:36:11.819697 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:36:11.830876 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:36:11.842077 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:36:11.853270 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:36:11.968654 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:36:12.090411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:12.563353 run create_hlr_db(pid=8616): Launched 12:36:12.694418 bus /sierra_2: Setting Powered False 12:36:13.759254 run create_hlr_db(pid=8616): Terminated: ok {rc=0} 12:36:14.181348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8618): Launched 12:36:14.504037 run osmo-hlr_10.42.42.2(pid=8619): Launched 12:36:14.628603 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:15.157503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8621): Launched 12:36:15.480217 run osmo-stp_10.42.42.5(pid=8622): Launched 12:36:15.604312 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:16.194935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8624): Launched 12:36:16.545697 run osmo-msc_10.42.42.6(pid=8625): Launched 12:36:16.864754 run osmo-stp_10.42.42.5(pid=8622): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8622)] 12:36:17.171830 run osmo-stp_10.42.42.5(pid=8622): stdout: | (launched: 2022-12-10_12:36:15.421832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:17.308614 run osmo-stp_10.42.42.5(pid=8622): stderr: | 20221210123615616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123615616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123615616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123615617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123615617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123615617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123615617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:17.443600 run osmo-stp_10.42.42.5(pid=8622): stdout: | (launched: 2022-12-10_12:36:15.421832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:17.573345 run osmo-stp_10.42.42.5(pid=8622): stderr: | 20221210123615616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123615616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123615616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123615617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123615617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123615617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123615617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:17.728335 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8622): Process ended prematurely: osmo-stp_10.42.42.5(pid=8622) [trial-2374↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8622)] [trial-2374↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 12:36:17.737464 tst handover.py:18: Test FAILED (7.0 sec) 12:36:17.765298 run osmo-hlr_10.42.42.2(pid=8619): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8619)] 12:36:17.816027 run osmo-hlr_10.42.42.2(pid=8619): stdout: | (launched: 2022-12-10_12:36:14.445648) 12:36:17.868075 run osmo-hlr_10.42.42.2(pid=8619): stderr: | 20221210123614645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123614645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123614645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123614646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123614646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123614646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123614674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123614686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123614687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123614687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:17.940938 run osmo-msc_10.42.42.6(pid=8625): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8625)] 12:36:17.991568 run osmo-msc_10.42.42.6(pid=8625): stdout: | (launched: 2022-12-10_12:36:16.475306) 12:36:18.043859 run osmo-msc_10.42.42.6(pid=8625): stderr: | 20221210123616939 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123616939 DLGLOBAL DEBUG validating counter group 0x7f97de052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123616939 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123616940 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123616940 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123616940 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123616942 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123616942 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123616942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123616942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:18.096339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8618): Terminating (SIGTERM) 12:36:18.138564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8621): Terminating (SIGTERM) 12:36:18.180712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8624): Terminating (SIGTERM) 12:36:18.223139 --- ParallelTerminationStrategy: PID 8618 died... 12:36:18.243395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8618): Terminated: ok {rc=0} 12:36:18.290358 --- ParallelTerminationStrategy: PID 8621 died... 12:36:18.310079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8621): Terminated: ok {rc=0} 12:36:18.356764 --- ParallelTerminationStrategy: PID 8624 died... 12:36:18.376634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8624): Terminated: ok {rc=0} 12:36:18.464883 bus /sierra_3: Setting Powered False 12:36:19.563653 bus /sierra_3: Setting Powered False 12:36:20.681416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:36:21.936238 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:21.942176 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:36:22.000218 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:36:22.026810 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:36:22.078007 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:36:22.135943 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:36:22.161905 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:36:22.713289 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:36:22.718751 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:22.729860 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:36:22.776789 tst handover.py: using LAC 28449 12:36:22.894260 tst handover.py: using RAC 144 12:36:23.014633 tst handover.py: using CellId 28449 12:36:23.132656 tst handover.py: using BVCI 28450 12:36:23.243219 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:36:23.289123 tst handover.py: using LAC 28450 12:36:23.413232 tst handover.py: using RAC 145 12:36:23.540342 tst handover.py: using CellId 28450 12:36:23.659804 tst handover.py: using BVCI 28451 12:36:23.768897 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:23.780099 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:23.791034 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:23.802364 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:23.813551 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:23.824612 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:36:23.937692 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:36:24.052487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:24.492353 run create_hlr_db(pid=8630): Launched 12:36:24.606499 bus /sierra_2: Setting Powered False 12:36:25.666930 run create_hlr_db(pid=8630): Terminated: ok {rc=0} 12:36:26.079357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8632): Launched 12:36:26.401266 run osmo-hlr_10.42.42.2(pid=8633): Launched 12:36:26.525713 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:27.053214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8635): Launched 12:36:27.374404 run osmo-stp_10.42.42.5(pid=8636): Launched 12:36:27.497226 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:28.050144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8638): Launched 12:36:28.371372 run osmo-msc_10.42.42.6(pid=8639): Launched 12:36:28.550893 run osmo-stp_10.42.42.5(pid=8636): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8636)] 12:36:28.686430 run osmo-stp_10.42.42.5(pid=8636): stdout: | (launched: 2022-12-10_12:36:27.316172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:28.821819 run osmo-stp_10.42.42.5(pid=8636): stderr: | 20221210123627508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123627508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123627508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123627508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123627509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123627509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123627509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:28.957474 run osmo-stp_10.42.42.5(pid=8636): stdout: | (launched: 2022-12-10_12:36:27.316172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:29.086601 run osmo-stp_10.42.42.5(pid=8636): stderr: | 20221210123627508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123627508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123627508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123627508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123627509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123627509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123627509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:29.239765 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8636): Process ended prematurely: osmo-stp_10.42.42.5(pid=8636) [trial-2374↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8636)] [trial-2374↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 12:36:29.248717 tst handover.py:18: Test FAILED (6.5 sec) 12:36:29.276022 run osmo-hlr_10.42.42.2(pid=8633): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8633)] 12:36:29.325707 run osmo-hlr_10.42.42.2(pid=8633): stdout: | (launched: 2022-12-10_12:36:26.343038) 12:36:29.377306 run osmo-hlr_10.42.42.2(pid=8633): stderr: | 20221210123626541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123626541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123626541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123626541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123626541 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123626541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123626558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123626567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123626567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123626567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:29.448565 run osmo-msc_10.42.42.6(pid=8639): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8639)] 12:36:29.498192 run osmo-msc_10.42.42.6(pid=8639): stdout: | (launched: 2022-12-10_12:36:28.313152) 12:36:29.549434 run osmo-msc_10.42.42.6(pid=8639): stderr: | 20221210123628632 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123628632 DLGLOBAL DEBUG validating counter group 0x7f35f41d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123628632 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123628632 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123628632 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123628633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123628634 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123628635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123628635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123628635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:29.601176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8632): Terminating (SIGTERM) 12:36:29.642320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8635): Terminating (SIGTERM) 12:36:29.683869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8638): Terminating (SIGTERM) 12:36:29.725789 --- ParallelTerminationStrategy: PID 8632 died... 12:36:29.745614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8632): Terminated: ok {rc=0} 12:36:29.791667 --- ParallelTerminationStrategy: PID 8635 died... 12:36:29.811218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8635): Terminated: ok {rc=0} 12:36:29.856883 --- ParallelTerminationStrategy: PID 8638 died... 12:36:29.876712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8638): Terminated: ok {rc=0} 12:36:29.963889 bus /sierra_3: Setting Powered False 12:36:31.060866 bus /sierra_3: Setting Powered False 12:36:32.183797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:36:33.448590 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:33.453720 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:36:33.516362 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:36:33.542711 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:36:33.594549 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:36:33.658151 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:36:33.684290 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:36:34.238503 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:36:34.244017 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:34.255429 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:36:34.307084 tst handover.py: using LAC 28451 12:36:34.432089 tst handover.py: using RAC 146 12:36:34.549429 tst handover.py: using CellId 28451 12:36:34.674776 tst handover.py: using BVCI 28452 12:36:34.791094 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:36:34.839298 tst handover.py: using LAC 28452 12:36:34.965256 tst handover.py: using RAC 147 12:36:35.090145 tst handover.py: using CellId 28452 12:36:35.214077 tst handover.py: using BVCI 28453 12:36:35.324118 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:35.335274 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:35.346255 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:35.358061 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:35.370086 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:35.381660 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:36:35.499991 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:36:35.621644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:36.092173 run create_hlr_db(pid=8644): Launched 12:36:36.223356 bus /sierra_2: Setting Powered False 12:36:37.287295 run create_hlr_db(pid=8644): Terminated: ok {rc=0} 12:36:37.707287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8646): Launched 12:36:38.029113 run osmo-hlr_10.42.42.2(pid=8647): Launched 12:36:38.153040 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:38.683395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8649): Launched 12:36:39.005122 run osmo-stp_10.42.42.5(pid=8650): Launched 12:36:39.130008 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:39.683704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8652): Launched 12:36:40.005192 run osmo-msc_10.42.42.6(pid=8653): Launched 12:36:40.185894 run osmo-stp_10.42.42.5(pid=8650): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8650)] 12:36:40.321547 run osmo-stp_10.42.42.5(pid=8650): stdout: | (launched: 2022-12-10_12:36:38.946770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:40.457410 run osmo-stp_10.42.42.5(pid=8650): stderr: | 20221210123639138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123639138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123639139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123639139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123639139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123639139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123639139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:40.592291 run osmo-stp_10.42.42.5(pid=8650): stdout: | (launched: 2022-12-10_12:36:38.946770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:40.721213 run osmo-stp_10.42.42.5(pid=8650): stderr: | 20221210123639138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123639138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123639139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123639139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123639139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123639139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123639139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:40.874983 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8650): Process ended prematurely: osmo-stp_10.42.42.5(pid=8650) [trial-2374↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8650)] [trial-2374↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 12:36:40.883947 tst handover.py:18: Test FAILED (6.6 sec) 12:36:40.911974 run osmo-hlr_10.42.42.2(pid=8647): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8647)] 12:36:40.962378 run osmo-hlr_10.42.42.2(pid=8647): stdout: | (launched: 2022-12-10_12:36:37.970870) 12:36:41.014491 run osmo-hlr_10.42.42.2(pid=8647): stderr: | 20221210123638168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123638168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123638168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123638169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123638169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123638169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123638183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123638193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123638193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123638193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:41.087355 run osmo-msc_10.42.42.6(pid=8653): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8653)] 12:36:41.138504 run osmo-msc_10.42.42.6(pid=8653): stdout: | (launched: 2022-12-10_12:36:39.946849) 12:36:41.190391 run osmo-msc_10.42.42.6(pid=8653): stderr: | 20221210123640268 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123640268 DLGLOBAL DEBUG validating counter group 0x7f6789683c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123640268 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123640269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123640269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123640269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123640271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123640271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123640271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123640271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:41.242503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8646): Terminating (SIGTERM) 12:36:41.284285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8649): Terminating (SIGTERM) 12:36:41.326322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8652): Terminating (SIGTERM) 12:36:41.368817 --- ParallelTerminationStrategy: PID 8646 died... 12:36:41.388871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8646): Terminated: ok {rc=0} 12:36:41.436133 --- ParallelTerminationStrategy: PID 8649 died... 12:36:41.456021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8649): Terminated: ok {rc=0} 12:36:41.502924 --- ParallelTerminationStrategy: PID 8652 died... 12:36:41.522753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8652): Terminated: ok {rc=0} 12:36:41.611210 bus /sierra_3: Setting Powered False 12:36:42.710959 bus /sierra_3: Setting Powered False 12:36:43.831734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 12:36:45.105326 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:45.111887 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:36:45.164469 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:36:45.192007 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:36:45.247293 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:36:45.299188 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:36:45.326629 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:36:45.877423 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 12:36:45.883739 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:36:45.899806 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:36:45.953411 tst handover.py: using LAC 28453 12:36:46.080654 tst handover.py: using RAC 148 12:36:46.208140 tst handover.py: using CellId 28453 12:36:46.366142 tst handover.py: using BVCI 28454 12:36:46.503524 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:36:46.541573 tst handover.py: using LAC 28454 12:36:46.700160 tst handover.py: using RAC 149 12:36:46.855233 tst handover.py: using CellId 28454 12:36:46.983763 tst handover.py: using BVCI 28455 12:36:47.095970 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:36:47.107087 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:36:47.118072 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:36:47.129928 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:36:47.141627 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:36:47.153657 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:36:47.290123 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:36:47.417643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:47.889606 run create_hlr_db(pid=8658): Launched 12:36:48.021206 bus /sierra_2: Setting Powered False 12:36:49.086286 run create_hlr_db(pid=8658): Terminated: ok {rc=0} 12:36:49.508119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8660): Launched 12:36:49.831499 run osmo-hlr_10.42.42.2(pid=8661): Launched 12:36:49.954868 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:50.480590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8663): Launched 12:36:50.802058 run osmo-stp_10.42.42.5(pid=8664): Launched 12:36:50.925358 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:51.479932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8666): Launched 12:36:51.801464 run osmo-msc_10.42.42.6(pid=8667): Launched 12:36:51.981351 run osmo-stp_10.42.42.5(pid=8664): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8664)] 12:36:52.116721 run osmo-stp_10.42.42.5(pid=8664): stdout: | (launched: 2022-12-10_12:36:50.743825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:52.251929 run osmo-stp_10.42.42.5(pid=8664): stderr: | 20221210123650935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123650935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123650935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123650936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123650936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123650936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123650937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:52.386742 run osmo-stp_10.42.42.5(pid=8664): stdout: | (launched: 2022-12-10_12:36:50.743825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:52.515376 run osmo-stp_10.42.42.5(pid=8664): stderr: | 20221210123650935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123650935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123650935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123650936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123650936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123650936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123650937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:52.669160 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8664): Process ended prematurely: osmo-stp_10.42.42.5(pid=8664) [trial-2374↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8664)] [trial-2374↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 12:36:52.678169 tst handover.py:18: Test FAILED (6.8 sec) 12:36:52.705988 run osmo-hlr_10.42.42.2(pid=8661): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8661)] 12:36:52.756304 run osmo-hlr_10.42.42.2(pid=8661): stdout: | (launched: 2022-12-10_12:36:49.772826) 12:36:52.808243 run osmo-hlr_10.42.42.2(pid=8661): stderr: | 20221210123649971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123649971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123649971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123649971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123649971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123649971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123649982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123649991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123649991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123649991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:52.880510 run osmo-msc_10.42.42.6(pid=8667): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8667)] 12:36:52.930716 run osmo-msc_10.42.42.6(pid=8667): stdout: | (launched: 2022-12-10_12:36:51.743208) 12:36:52.982458 run osmo-msc_10.42.42.6(pid=8667): stderr: | 20221210123652066 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123652066 DLGLOBAL DEBUG validating counter group 0x7f1d5d956c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123652066 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123652066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123652066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123652067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123652068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123652069 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123652069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123652069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:53.034324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8660): Terminating (SIGTERM) 12:36:53.076381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8663): Terminating (SIGTERM) 12:36:53.118446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8666): Terminating (SIGTERM) 12:36:53.161113 --- ParallelTerminationStrategy: PID 8660 died... 12:36:53.181146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8660): Terminated: ok {rc=0} 12:36:53.228100 --- ParallelTerminationStrategy: PID 8663 died... 12:36:53.247785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8663): Terminated: ok {rc=0} 12:36:53.294555 --- ParallelTerminationStrategy: PID 8666 died... 12:36:53.314122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8666): Terminated: ok {rc=0} 12:36:53.402738 bus /sierra_3: Setting Powered False 12:36:54.499085 bus /sierra_3: Setting Powered False 12:36:55.613608 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 12:36:56.868217 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:56.873443 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:36:56.935695 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:36:56.962168 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:36:57.013799 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:36:57.075371 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:36:57.101686 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:36:57.650510 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 12:36:57.655718 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:57.666512 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:36:57.714005 tst handover.py: using LAC 28455 12:36:57.833999 tst handover.py: using RAC 150 12:36:57.954029 tst handover.py: using CellId 28455 12:36:58.071480 tst handover.py: using BVCI 28456 12:36:58.181569 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:36:58.228942 tst handover.py: using LAC 28456 12:36:58.347720 tst handover.py: using RAC 151 12:36:58.469095 tst handover.py: using CellId 28456 12:36:58.585381 tst handover.py: using BVCI 28457 12:36:58.696352 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:58.707122 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:58.717683 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:58.728436 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:58.739315 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:36:58.750001 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:36:58.867033 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:36:58.985309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:59.458247 run create_hlr_db(pid=8672): Launched 12:36:59.588864 bus /sierra_2: Setting Powered False 12:37:00.653196 run create_hlr_db(pid=8672): Terminated: ok {rc=0} 12:37:01.096791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8674): Launched 12:37:01.518561 run osmo-hlr_10.42.42.2(pid=8675): Launched 12:37:01.782113 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:02.496763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8677): Launched 12:37:02.825771 run osmo-stp_10.42.42.5(pid=8678): Launched 12:37:02.948348 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:03.506264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8680): Launched 12:37:03.829437 run osmo-msc_10.42.42.6(pid=8681): Launched 12:37:04.010122 run osmo-stp_10.42.42.5(pid=8678): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8678)] 12:37:04.146601 run osmo-stp_10.42.42.5(pid=8678): stdout: | (launched: 2022-12-10_12:37:02.767508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:04.283326 run osmo-stp_10.42.42.5(pid=8678): stderr: | 20221210123702961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123702962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123702962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123702962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123702963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123702963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123702963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:04.418624 run osmo-stp_10.42.42.5(pid=8678): stdout: | (launched: 2022-12-10_12:37:02.767508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:04.547472 run osmo-stp_10.42.42.5(pid=8678): stderr: | 20221210123702961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123702962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123702962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123702962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123702963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123702963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123702963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:04.701968 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8678): Process ended prematurely: osmo-stp_10.42.42.5(pid=8678) [trial-2374↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8678)] [trial-2374↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 12:37:04.710941 tst handover.py:18: Test FAILED (7.0 sec) 12:37:04.738552 run osmo-hlr_10.42.42.2(pid=8675): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8675)] 12:37:04.788775 run osmo-hlr_10.42.42.2(pid=8675): stdout: | (launched: 2022-12-10_12:37:01.441200) 12:37:04.840745 run osmo-hlr_10.42.42.2(pid=8675): stderr: | 20221210123701686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123701686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123701686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123701686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123701686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123701686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123701706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123701732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123701732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123701732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:04.912990 run osmo-msc_10.42.42.6(pid=8681): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8681)] 12:37:04.962719 run osmo-msc_10.42.42.6(pid=8681): stdout: | (launched: 2022-12-10_12:37:03.770520) 12:37:05.014049 run osmo-msc_10.42.42.6(pid=8681): stderr: | 20221210123704092 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123704092 DLGLOBAL DEBUG validating counter group 0x7f5365ee5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123704092 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123704092 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123704093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123704093 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123704094 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123704095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123704095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123704095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:05.066098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8674): Terminating (SIGTERM) 12:37:05.107491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8677): Terminating (SIGTERM) 12:37:05.149553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8680): Terminating (SIGTERM) 12:37:05.191770 --- ParallelTerminationStrategy: PID 8674 died... 12:37:05.211795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8674): Terminated: ok {rc=0} 12:37:05.258622 --- ParallelTerminationStrategy: PID 8677 died... 12:37:05.278445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8677): Terminated: ok {rc=0} 12:37:05.325245 --- ParallelTerminationStrategy: PID 8680 died... 12:37:05.344734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8680): Terminated: ok {rc=0} 12:37:05.433371 bus /sierra_3: Setting Powered False 12:37:06.532482 bus /sierra_3: Setting Powered False 12:37:07.651012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 12:37:08.927735 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:08.933427 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:37:08.996188 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:37:09.023114 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:37:09.081226 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:37:09.144492 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:37:09.171536 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:37:09.716739 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 12:37:09.722154 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:09.733331 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:37:09.781687 tst handover.py: using LAC 28457 12:37:09.906936 tst handover.py: using RAC 152 12:37:10.033119 tst handover.py: using CellId 28457 12:37:10.162878 tst handover.py: using BVCI 28458 12:37:10.281142 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:37:10.328392 tst handover.py: using LAC 28458 12:37:10.454664 tst handover.py: using RAC 153 12:37:10.578599 tst handover.py: using CellId 28458 12:37:10.703295 tst handover.py: using BVCI 28459 12:37:10.819802 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:10.831007 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:10.842013 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:10.853033 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:10.864209 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:10.875082 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:37:10.993850 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:37:11.108663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:11.550576 run create_hlr_db(pid=8686): Launched 12:37:11.667394 bus /sierra_2: Setting Powered False 12:37:12.727576 run create_hlr_db(pid=8686): Terminated: ok {rc=0} 12:37:13.122548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8688): Launched 12:37:13.424441 run osmo-hlr_10.42.42.2(pid=8689): Launched 12:37:13.540534 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:14.045311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8691): Launched 12:37:14.345635 run osmo-stp_10.42.42.5(pid=8692): Launched 12:37:14.460780 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:14.979236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8694): Launched 12:37:15.280322 run osmo-msc_10.42.42.6(pid=8695): Launched 12:37:15.450581 run osmo-stp_10.42.42.5(pid=8692): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8692)] 12:37:15.578681 run osmo-stp_10.42.42.5(pid=8692): stdout: | (launched: 2022-12-10_12:37:14.290518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:15.705804 run osmo-stp_10.42.42.5(pid=8692): stderr: | 20221210123714460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123714460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123714460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123714461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123714461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123714461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123714461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:15.834730 run osmo-stp_10.42.42.5(pid=8692): stdout: | (launched: 2022-12-10_12:37:14.290518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:15.959541 run osmo-stp_10.42.42.5(pid=8692): stderr: | 20221210123714460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123714460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123714460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123714461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123714461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123714461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123714461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:16.109363 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8692): Process ended prematurely: osmo-stp_10.42.42.5(pid=8692) [trial-2374↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8692)] [trial-2374↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 12:37:16.118695 tst handover.py:18: Test FAILED (6.4 sec) 12:37:16.148599 run osmo-hlr_10.42.42.2(pid=8689): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8689)] 12:37:16.199632 run osmo-hlr_10.42.42.2(pid=8689): stdout: | (launched: 2022-12-10_12:37:13.369545) 12:37:16.251930 run osmo-hlr_10.42.42.2(pid=8689): stderr: | 20221210123713545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123713545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123713545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123713545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123713545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123713545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123713557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123713566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123713566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123713566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:16.324233 run osmo-msc_10.42.42.6(pid=8695): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8695)] 12:37:16.375369 run osmo-msc_10.42.42.6(pid=8695): stdout: | (launched: 2022-12-10_12:37:15.225492) 12:37:16.427603 run osmo-msc_10.42.42.6(pid=8695): stderr: | 20221210123715496 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123715496 DLGLOBAL DEBUG validating counter group 0x7fe26e947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123715496 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123715496 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123715496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123715496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123715498 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123715499 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123715499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123715499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:16.480801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8688): Terminating (SIGTERM) 12:37:16.523504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8691): Terminating (SIGTERM) 12:37:16.566133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8694): Terminating (SIGTERM) 12:37:16.608849 --- ParallelTerminationStrategy: PID 8688 died... 12:37:16.628815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8688): Terminated: ok {rc=0} 12:37:16.676317 --- ParallelTerminationStrategy: PID 8691 died... 12:37:16.695966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8691): Terminated: ok {rc=0} 12:37:16.743876 --- ParallelTerminationStrategy: PID 8694 died... 12:37:16.763793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8694): Terminated: ok {rc=0} 12:37:16.852325 bus /sierra_3: Setting Powered False 12:37:17.949861 bus /sierra_3: Setting Powered False 12:37:19.063730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:37:20.337047 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:20.342491 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:37:20.403680 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:37:20.430627 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:37:20.484913 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:37:20.546156 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:37:20.573713 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:37:21.126615 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:37:21.132314 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:37:21.143939 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:37:21.188660 tst handover.py: using LAC 28459 12:37:21.316693 tst handover.py: using RAC 154 12:37:21.436462 tst handover.py: using CellId 28459 12:37:21.560857 tst handover.py: using BVCI 28460 12:37:21.671454 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:37:21.718462 tst handover.py: using LAC 28460 12:37:21.837237 tst handover.py: using RAC 155 12:37:21.954418 tst handover.py: using CellId 28460 12:37:22.070218 tst handover.py: using BVCI 28461 12:37:22.178995 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:37:22.190072 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:37:22.200896 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:37:22.212107 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:37:22.223376 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:37:22.234577 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:37:22.351557 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:37:22.470166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:22.942194 run create_hlr_db(pid=8700): Launched 12:37:23.074224 bus /sierra_2: Setting Powered False 12:37:24.134118 run create_hlr_db(pid=8700): Terminated: ok {rc=0} 12:37:24.546377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8702): Launched 12:37:24.866809 run osmo-hlr_10.42.42.2(pid=8703): Launched 12:37:24.984697 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:25.493228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8705): Launched 12:37:25.794037 run osmo-stp_10.42.42.5(pid=8706): Launched 12:37:25.908473 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:26.428836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8708): Launched 12:37:26.730614 run osmo-msc_10.42.42.6(pid=8709): Launched 12:37:26.900025 run osmo-stp_10.42.42.5(pid=8706): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8706)] 12:37:27.027230 run osmo-stp_10.42.42.5(pid=8706): stdout: | (launched: 2022-12-10_12:37:25.739259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:27.154776 run osmo-stp_10.42.42.5(pid=8706): stderr: | 20221210123725908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123725908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123725908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123725909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123725911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123725911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123725911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:27.279808 run osmo-stp_10.42.42.5(pid=8706): stdout: | (launched: 2022-12-10_12:37:25.739259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:27.399854 run osmo-stp_10.42.42.5(pid=8706): stderr: | 20221210123725908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123725908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123725908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123725909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123725911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123725911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123725911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:27.543994 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8706): Process ended prematurely: osmo-stp_10.42.42.5(pid=8706) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8706)] [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 12:37:27.552403 tst handover.py:18: Test FAILED (6.4 sec) 12:37:27.579007 run osmo-hlr_10.42.42.2(pid=8703): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8703)] 12:37:27.626678 run osmo-hlr_10.42.42.2(pid=8703): stdout: | (launched: 2022-12-10_12:37:24.811827) 12:37:27.675923 run osmo-hlr_10.42.42.2(pid=8703): stderr: | 20221210123724983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123724983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123724983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123724983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123724983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123724983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123724997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123725006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123725007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123725007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:27.744245 run osmo-msc_10.42.42.6(pid=8709): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8709)] 12:37:27.791822 run osmo-msc_10.42.42.6(pid=8709): stdout: | (launched: 2022-12-10_12:37:26.675434) 12:37:27.840823 run osmo-msc_10.42.42.6(pid=8709): stderr: | 20221210123726946 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123726946 DLGLOBAL DEBUG validating counter group 0x7fc06a7c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123726947 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123726947 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123726947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123726947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123726949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123726949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123726949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123726949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:27.890713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8702): Terminating (SIGTERM) 12:37:27.930076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8705): Terminating (SIGTERM) 12:37:27.969553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8708): Terminating (SIGTERM) 12:37:28.009511 --- ParallelTerminationStrategy: PID 8702 died... 12:37:28.028688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8702): Terminated: ok {rc=0} 12:37:28.073057 --- ParallelTerminationStrategy: PID 8705 died... 12:37:28.091682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8705): Terminated: ok {rc=0} 12:37:28.135758 --- ParallelTerminationStrategy: PID 8708 died... 12:37:28.154419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8708): Terminated: ok {rc=0} 12:37:28.239680 bus /sierra_3: Setting Powered False 12:37:29.337490 bus /sierra_3: Setting Powered False 12:37:30.452025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 12:37:31.735016 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:31.742445 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:37:31.803388 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:37:31.836276 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:37:31.900423 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:37:31.965855 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:37:31.994330 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:37:32.527908 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 12:37:32.533741 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:32.545232 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:37:32.593688 tst handover.py: using LAC 28461 12:37:32.719808 tst handover.py: using RAC 156 12:37:32.844373 tst handover.py: using CellId 28461 12:37:32.969088 tst handover.py: using BVCI 28462 12:37:33.087517 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:37:33.121956 tst handover.py: using LAC 28462 12:37:33.246742 tst handover.py: using RAC 157 12:37:33.371474 tst handover.py: using CellId 28462 12:37:33.498397 tst handover.py: using BVCI 28463 12:37:33.616914 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:33.628260 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:33.639400 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:33.651181 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:33.662831 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:33.674472 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:37:33.792692 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:37:33.912480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:34.383713 run create_hlr_db(pid=8714): Launched 12:37:34.514053 bus /sierra_2: Setting Powered False 12:37:35.578141 run create_hlr_db(pid=8714): Terminated: ok {rc=0} 12:37:35.985473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8716): Launched 12:37:36.307621 run osmo-hlr_10.42.42.2(pid=8719): Launched 12:37:36.430330 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:36.954109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8721): Launched 12:37:37.276441 run osmo-stp_10.42.42.5(pid=8722): Launched 12:37:37.399340 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:37.952737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8724): Launched 12:37:38.273651 run osmo-msc_10.42.42.6(pid=8725): Launched 12:37:38.453299 run osmo-stp_10.42.42.5(pid=8722): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8722)] 12:37:38.588236 run osmo-stp_10.42.42.5(pid=8722): stdout: | (launched: 2022-12-10_12:37:37.217998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:38.724003 run osmo-stp_10.42.42.5(pid=8722): stderr: | 20221210123737410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123737410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123737411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123737411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123737412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123737412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123737412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:38.858566 run osmo-stp_10.42.42.5(pid=8722): stdout: | (launched: 2022-12-10_12:37:37.217998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:38.987044 run osmo-stp_10.42.42.5(pid=8722): stderr: | 20221210123737410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123737410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123737411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123737411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123737412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123737412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123737412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:39.140904 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8722): Process ended prematurely: osmo-stp_10.42.42.5(pid=8722) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8722)] [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 12:37:39.149735 tst handover.py:18: Test FAILED (6.6 sec) 12:37:39.177044 run osmo-hlr_10.42.42.2(pid=8719): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8719)] 12:37:39.226316 run osmo-hlr_10.42.42.2(pid=8719): stdout: | (launched: 2022-12-10_12:37:36.249573) 12:37:39.277593 run osmo-hlr_10.42.42.2(pid=8719): stderr: | 20221210123736447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123736447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123736447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123736447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123736447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123736447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123736457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123736466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123736466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123736466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:39.348902 run osmo-msc_10.42.42.6(pid=8725): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8725)] 12:37:39.398075 run osmo-msc_10.42.42.6(pid=8725): stdout: | (launched: 2022-12-10_12:37:38.215013) 12:37:39.448868 run osmo-msc_10.42.42.6(pid=8725): stderr: | 20221210123738537 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123738537 DLGLOBAL DEBUG validating counter group 0x7f62e1b16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123738537 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123738537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123738537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123738538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123738539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123738540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123738540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123738540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:39.499962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8716): Terminating (SIGTERM) 12:37:39.541140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8721): Terminating (SIGTERM) 12:37:39.582398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8724): Terminating (SIGTERM) 12:37:39.623900 --- ParallelTerminationStrategy: PID 8716 died... 12:37:39.643673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8716): Terminated: ok {rc=0} 12:37:39.689205 --- ParallelTerminationStrategy: PID 8721 died... 12:37:39.708332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8721): Terminated: ok {rc=0} 12:37:39.753893 --- ParallelTerminationStrategy: PID 8724 died... 12:37:39.773358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8724): Terminated: ok {rc=0} 12:37:39.860600 bus /sierra_3: Setting Powered False 12:37:40.960103 bus /sierra_3: Setting Powered False 12:37:42.076092 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 12:37:43.325162 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:43.330336 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:37:43.388777 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:37:43.415464 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:37:43.468350 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:37:43.527320 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:37:43.553857 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:37:44.102763 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 12:37:44.108321 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:44.119510 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:37:44.162583 tst handover.py: using LAC 28463 12:37:44.281625 tst handover.py: using RAC 158 12:37:44.409981 tst handover.py: using CellId 28463 12:37:44.537780 tst handover.py: using BVCI 28464 12:37:44.654831 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:37:44.704239 tst handover.py: using LAC 28464 12:37:44.831919 tst handover.py: using RAC 159 12:37:44.959028 tst handover.py: using CellId 28464 12:37:45.084328 tst handover.py: using BVCI 28465 12:37:45.200159 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:45.211674 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:45.223083 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:45.234522 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:45.245900 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:45.257253 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:37:45.371560 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:37:45.487743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:45.989759 run create_hlr_db(pid=8730): Launched 12:37:46.144272 bus /sierra_2: Setting Powered False 12:37:47.206799 run create_hlr_db(pid=8730): Terminated: ok {rc=0} 12:37:47.613228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8732): Launched 12:37:47.915492 run osmo-hlr_10.42.42.2(pid=8733): Launched 12:37:48.031386 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:48.537713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8735): Launched 12:37:48.837549 run osmo-stp_10.42.42.5(pid=8736): Launched 12:37:48.953833 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:49.470853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8738): Launched 12:37:49.772429 run osmo-msc_10.42.42.6(pid=8739): Launched 12:37:49.941390 run osmo-stp_10.42.42.5(pid=8736): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8736)] 12:37:50.068654 run osmo-stp_10.42.42.5(pid=8736): stdout: | (launched: 2022-12-10_12:37:48.782613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:50.196144 run osmo-stp_10.42.42.5(pid=8736): stderr: | 20221210123748953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123748953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123748953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123748954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123748954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123748954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123748954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:50.320557 run osmo-stp_10.42.42.5(pid=8736): stdout: | (launched: 2022-12-10_12:37:48.782613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:50.439703 run osmo-stp_10.42.42.5(pid=8736): stderr: | 20221210123748953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123748953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123748953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123748954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123748954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123748954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123748954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:50.582385 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8736): Process ended prematurely: osmo-stp_10.42.42.5(pid=8736) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8736)] [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 12:37:50.590618 tst handover.py:18: Test FAILED (6.5 sec) 12:37:50.616620 run osmo-hlr_10.42.42.2(pid=8733): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8733)] 12:37:50.663961 run osmo-hlr_10.42.42.2(pid=8733): stdout: | (launched: 2022-12-10_12:37:47.860295) 12:37:50.712742 run osmo-hlr_10.42.42.2(pid=8733): stderr: | 20221210123748035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123748035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123748035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123748035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123748035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123748035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123748047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123748056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123748056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123748056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:50.781091 run osmo-msc_10.42.42.6(pid=8739): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8739)] 12:37:50.828229 run osmo-msc_10.42.42.6(pid=8739): stdout: | (launched: 2022-12-10_12:37:49.717074) 12:37:50.877060 run osmo-msc_10.42.42.6(pid=8739): stderr: | 20221210123749987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123749987 DLGLOBAL DEBUG validating counter group 0x7fcec3d4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123749987 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123749987 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123749987 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123749987 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123749989 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123749989 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123749990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123749990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:50.926051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8732): Terminating (SIGTERM) 12:37:50.965176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8735): Terminating (SIGTERM) 12:37:51.004483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8738): Terminating (SIGTERM) 12:37:51.044111 --- ParallelTerminationStrategy: PID 8732 died... 12:37:51.062990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8732): Terminated: ok {rc=0} 12:37:51.106750 --- ParallelTerminationStrategy: PID 8735 died... 12:37:51.125042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8735): Terminated: ok {rc=0} 12:37:51.168532 --- ParallelTerminationStrategy: PID 8738 died... 12:37:51.187206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8738): Terminated: ok {rc=0} 12:37:51.271819 bus /sierra_3: Setting Powered False 12:37:52.369531 bus /sierra_3: Setting Powered False 12:37:53.482664 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 12:37:54.752391 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:54.758107 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:37:54.816873 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:37:54.843838 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:37:54.896354 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:37:54.955111 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:37:54.982281 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:37:55.535908 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 12:37:55.541323 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:55.552612 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:37:55.604026 tst handover.py: using LAC 28465 12:37:55.729794 tst handover.py: using RAC 160 12:37:55.854186 tst handover.py: using CellId 28465 12:37:55.980296 tst handover.py: using BVCI 28466 12:37:56.097255 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:37:56.143859 tst handover.py: using LAC 28466 12:37:56.269380 tst handover.py: using RAC 161 12:37:56.393547 tst handover.py: using CellId 28466 12:37:56.513949 tst handover.py: using BVCI 28467 12:37:56.625507 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:56.636502 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:56.647434 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:56.659308 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:56.671167 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:56.682936 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:37:56.802337 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:37:56.918064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:57.360417 run create_hlr_db(pid=8744): Launched 12:37:57.475932 bus /sierra_2: Setting Powered False 12:37:58.535823 run create_hlr_db(pid=8744): Terminated: ok {rc=0} 12:37:58.930941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8746): Launched 12:37:59.232212 run osmo-hlr_10.42.42.2(pid=8747): Launched 12:37:59.348084 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:59.854357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8749): Launched 12:38:00.155022 run osmo-stp_10.42.42.5(pid=8750): Launched 12:38:00.270455 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:00.786166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8752): Launched 12:38:01.116012 run osmo-msc_10.42.42.6(pid=8753): Launched 12:38:01.313025 run osmo-stp_10.42.42.5(pid=8750): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8750)] 12:38:01.496687 run osmo-stp_10.42.42.5(pid=8750): stdout: | (launched: 2022-12-10_12:38:00.099833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:01.766564 run osmo-stp_10.42.42.5(pid=8750): stderr: | 20221210123800268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123800268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123800269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123800269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123800271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123800272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123800272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:02.063543 run osmo-stp_10.42.42.5(pid=8750): stdout: | (launched: 2022-12-10_12:38:00.099833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:02.236637 run osmo-stp_10.42.42.5(pid=8750): stderr: | 20221210123800268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123800268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123800269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123800269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123800271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123800272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123800272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:02.430454 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8750): Process ended prematurely: osmo-stp_10.42.42.5(pid=8750) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8750)] [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 12:38:02.439456 tst handover.py:18: Test FAILED (6.9 sec) 12:38:02.468700 run osmo-hlr_10.42.42.2(pid=8747): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8747)] 12:38:02.518558 run osmo-hlr_10.42.42.2(pid=8747): stdout: | (launched: 2022-12-10_12:37:59.177213) 12:38:02.570085 run osmo-hlr_10.42.42.2(pid=8747): stderr: | 20221210123759354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123759354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123759355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123759355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123759355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123759355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123759366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123759375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123759375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123759375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:02.640447 run osmo-msc_10.42.42.6(pid=8753): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8753)] 12:38:02.689275 run osmo-msc_10.42.42.6(pid=8753): stdout: | (launched: 2022-12-10_12:38:01.053802) 12:38:02.739559 run osmo-msc_10.42.42.6(pid=8753): stderr: | 20221210123801650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123801651 DLGLOBAL DEBUG validating counter group 0x7fac9cc30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123801651 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123801651 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123801652 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123801652 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123801657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123801658 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123801658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123801658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:02.789896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8746): Terminating (SIGTERM) 12:38:02.830103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8749): Terminating (SIGTERM) 12:38:02.870240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8752): Terminating (SIGTERM) 12:38:02.910757 --- ParallelTerminationStrategy: PID 8746 died... 12:38:02.929923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8746): Terminated: ok {rc=0} 12:38:02.975737 --- ParallelTerminationStrategy: PID 8749 died... 12:38:02.994633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8749): Terminated: ok {rc=0} 12:38:03.040352 --- ParallelTerminationStrategy: PID 8752 died... 12:38:03.059386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8752): Terminated: ok {rc=0} 12:38:03.147277 bus /sierra_3: Setting Powered False 12:38:04.246761 bus /sierra_3: Setting Powered False 12:38:05.361433 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 12:38:06.625324 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:06.630466 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:38:06.681984 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:38:06.708406 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:38:06.762386 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:38:06.814754 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:38:06.842151 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:38:07.388478 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 12:38:07.395194 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:07.407044 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:38:07.455572 tst handover.py: using LAC 28467 12:38:07.578582 tst handover.py: using RAC 162 12:38:07.697956 tst handover.py: using CellId 28467 12:38:07.817655 tst handover.py: using BVCI 28468 12:38:07.927138 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:38:07.962220 tst handover.py: using LAC 28468 12:38:08.082366 tst handover.py: using RAC 163 12:38:08.200908 tst handover.py: using CellId 28468 12:38:08.327245 tst handover.py: using BVCI 28469 12:38:08.445898 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:08.457090 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:08.468061 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:08.479165 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:08.490371 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:08.501509 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:38:08.617716 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:38:08.731345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:09.172423 run create_hlr_db(pid=8758): Launched 12:38:09.288340 bus /sierra_2: Setting Powered False 12:38:10.348929 run create_hlr_db(pid=8758): Terminated: ok {rc=0} 12:38:10.762378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8760): Launched 12:38:11.085040 run osmo-hlr_10.42.42.2(pid=8761): Launched 12:38:11.209671 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:11.738440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8763): Launched 12:38:12.060672 run osmo-stp_10.42.42.5(pid=8764): Launched 12:38:12.185212 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:12.739296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8766): Launched 12:38:13.061097 run osmo-msc_10.42.42.6(pid=8767): Launched 12:38:13.241501 run osmo-stp_10.42.42.5(pid=8764): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8764)] 12:38:13.377733 run osmo-stp_10.42.42.5(pid=8764): stdout: | (launched: 2022-12-10_12:38:12.002390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:13.513513 run osmo-stp_10.42.42.5(pid=8764): stderr: | 20221210123812196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123812196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123812197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123812197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123812198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123812198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123812198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:13.648107 run osmo-stp_10.42.42.5(pid=8764): stdout: | (launched: 2022-12-10_12:38:12.002390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:13.776726 run osmo-stp_10.42.42.5(pid=8764): stderr: | 20221210123812196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123812196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123812197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123812197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123812198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123812198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123812198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:13.930989 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8764): Process ended prematurely: osmo-stp_10.42.42.5(pid=8764) [trial-2374↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8764)] [trial-2374↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 12:38:13.939613 tst handover.py:18: Test FAILED (6.5 sec) 12:38:13.967023 run osmo-hlr_10.42.42.2(pid=8761): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8761)] 12:38:14.017185 run osmo-hlr_10.42.42.2(pid=8761): stdout: | (launched: 2022-12-10_12:38:11.026275) 12:38:14.068835 run osmo-hlr_10.42.42.2(pid=8761): stderr: | 20221210123811224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123811224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123811224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123811224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123811224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123811224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123811236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123811244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123811244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123811244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:14.141418 run osmo-msc_10.42.42.6(pid=8767): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8767)] 12:38:14.191485 run osmo-msc_10.42.42.6(pid=8767): stdout: | (launched: 2022-12-10_12:38:13.002622) 12:38:14.242884 run osmo-msc_10.42.42.6(pid=8767): stderr: | 20221210123813329 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123813329 DLGLOBAL DEBUG validating counter group 0x7f2117ee8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123813329 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123813330 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123813330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123813330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123813332 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123813332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123813332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123813332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:14.295198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8760): Terminating (SIGTERM) 12:38:14.336850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8763): Terminating (SIGTERM) 12:38:14.378593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8766): Terminating (SIGTERM) 12:38:14.420463 --- ParallelTerminationStrategy: PID 8760 died... 12:38:14.440440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8760): Terminated: ok {rc=0} 12:38:14.486528 --- ParallelTerminationStrategy: PID 8763 died... 12:38:14.505992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8763): Terminated: ok {rc=0} 12:38:14.551947 --- ParallelTerminationStrategy: PID 8766 died... 12:38:14.571489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8766): Terminated: ok {rc=0} 12:38:14.658670 bus /sierra_3: Setting Powered False 12:38:15.756167 bus /sierra_3: Setting Powered False 12:38:16.896558 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 12:38:18.236727 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:18.244581 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:38:18.325023 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:38:18.354247 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:38:18.420664 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:38:18.524737 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:38:18.559703 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:38:19.059475 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 12:38:19.066421 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:19.078747 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:38:19.130230 tst handover.py: using LAC 28469 12:38:19.253431 tst handover.py: using RAC 164 12:38:19.376604 tst handover.py: using CellId 28469 12:38:19.497425 tst handover.py: using BVCI 28470 12:38:19.610083 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:38:19.661963 tst handover.py: using LAC 28470 12:38:19.783103 tst handover.py: using RAC 165 12:38:19.903090 tst handover.py: using CellId 28470 12:38:20.024407 tst handover.py: using BVCI 28471 12:38:20.139068 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:20.150940 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:20.162644 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:20.176169 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:20.187839 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:20.200387 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:38:20.320893 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:38:20.439530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:20.906062 run create_hlr_db(pid=9044): Launched 12:38:21.063260 bus /sierra_2: Setting Powered False 12:38:22.125501 run create_hlr_db(pid=9044): Terminated: ok {rc=0} 12:38:22.544526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9046): Launched 12:38:22.872083 run osmo-hlr_10.42.42.2(pid=9047): Launched 12:38:23.112050 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:23.826034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9049): Launched 12:38:24.157739 run osmo-stp_10.42.42.5(pid=9050): Launched 12:38:24.401602 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:25.105810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9052): Launched 12:38:25.439914 run osmo-msc_10.42.42.6(pid=9053): Launched 12:38:25.791968 run osmo-stp_10.42.42.5(pid=9050): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9050)] 12:38:26.058935 run osmo-stp_10.42.42.5(pid=9050): stdout: | (launched: 2022-12-10_12:38:24.085794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:26.337151 run osmo-stp_10.42.42.5(pid=9050): stderr: | 20221210123824416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123824416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123824417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123824417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123824418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123824418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123824418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:26.514581 run osmo-stp_10.42.42.5(pid=9050): stdout: | (launched: 2022-12-10_12:38:24.085794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:26.640689 run osmo-stp_10.42.42.5(pid=9050): stderr: | 20221210123824416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123824416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123824417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123824417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123824418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123824418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123824418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:26.791948 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9050): Process ended prematurely: osmo-stp_10.42.42.5(pid=9050) [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9050)] [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 12:38:26.801339 tst handover.py:18: Test FAILED (7.7 sec) 12:38:26.831087 run osmo-hlr_10.42.42.2(pid=9047): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9047)] 12:38:26.881902 run osmo-hlr_10.42.42.2(pid=9047): stdout: | (launched: 2022-12-10_12:38:22.805107) 12:38:26.935765 run osmo-hlr_10.42.42.2(pid=9047): stderr: | 20221210123823150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123823150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123823150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123823150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123823150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123823150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123823166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123823179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123823179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123823179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:27.009691 run osmo-msc_10.42.42.6(pid=9053): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9053)] 12:38:27.060168 run osmo-msc_10.42.42.6(pid=9053): stdout: | (launched: 2022-12-10_12:38:25.371085) 12:38:27.113626 run osmo-msc_10.42.42.6(pid=9053): stderr: | 20221210123825979 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123825979 DLGLOBAL DEBUG validating counter group 0x7f8e8ae7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123825979 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123825979 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123825979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123825979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123825981 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123825981 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123825982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123825982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:27.166396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9046): Terminating (SIGTERM) 12:38:27.209606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9049): Terminating (SIGTERM) 12:38:27.254426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9052): Terminating (SIGTERM) 12:38:27.300221 --- ParallelTerminationStrategy: PID 9046 died... 12:38:27.320381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9046): Terminated: ok {rc=0} 12:38:27.370175 --- ParallelTerminationStrategy: PID 9049 died... 12:38:27.390000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9049): Terminated: ok {rc=0} 12:38:27.438129 --- ParallelTerminationStrategy: PID 9052 died... 12:38:27.458423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9052): Terminated: ok {rc=0} 12:38:27.549406 bus /sierra_3: Setting Powered False 12:38:28.651059 bus /sierra_3: Setting Powered False 12:38:29.769909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 12:38:31.082355 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:31.088533 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:38:31.163002 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:38:31.191868 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:38:31.250644 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:38:31.335798 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:38:31.372783 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:38:31.920593 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 12:38:31.927799 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:31.944236 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:38:32.007969 tst handover.py: using LAC 28471 12:38:32.152870 tst handover.py: using RAC 166 12:38:32.295739 tst handover.py: using CellId 28471 12:38:32.454638 tst handover.py: using BVCI 28472 12:38:32.625566 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:38:32.688330 tst handover.py: using LAC 28472 12:38:32.824936 tst handover.py: using RAC 167 12:38:32.986210 tst handover.py: using CellId 28472 12:38:33.137100 tst handover.py: using BVCI 28473 12:38:33.271884 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:33.284079 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:33.297240 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:33.309305 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:33.321359 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:33.333452 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:38:33.456059 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:38:33.578022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:34.078126 run create_hlr_db(pid=9058): Launched 12:38:34.241967 bus /sierra_2: Setting Powered False 12:38:35.309302 run create_hlr_db(pid=9058): Terminated: ok {rc=0} 12:38:35.761730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9060): Launched 12:38:36.112771 run osmo-hlr_10.42.42.2(pid=9061): Launched 12:38:36.367272 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:37.031240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9063): Launched 12:38:37.390285 run osmo-stp_10.42.42.5(pid=9064): Launched 12:38:37.635886 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:38.296103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9066): Launched 12:38:38.646003 run osmo-msc_10.42.42.6(pid=9067): Launched 12:38:38.924519 run osmo-stp_10.42.42.5(pid=9064): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9064)] 12:38:39.052595 run osmo-stp_10.42.42.5(pid=9064): stdout: | (launched: 2022-12-10_12:38:37.313266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:39.179573 run osmo-stp_10.42.42.5(pid=9064): stderr: | 20221210123837620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123837620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123837620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123837620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123837621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123837621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123837621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:39.305461 run osmo-stp_10.42.42.5(pid=9064): stdout: | (launched: 2022-12-10_12:38:37.313266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:39.426114 run osmo-stp_10.42.42.5(pid=9064): stderr: | 20221210123837620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123837620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123837620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123837620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123837621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123837621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123837621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:39.570633 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9064): Process ended prematurely: osmo-stp_10.42.42.5(pid=9064) [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9064)] [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 12:38:39.579242 tst handover.py:18: Test FAILED (7.6 sec) 12:38:39.606315 run osmo-hlr_10.42.42.2(pid=9061): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9061)] 12:38:39.654751 run osmo-hlr_10.42.42.2(pid=9061): stdout: | (launched: 2022-12-10_12:38:36.044000) 12:38:39.705082 run osmo-hlr_10.42.42.2(pid=9061): stderr: | 20221210123836362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123836362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123836362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123836363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123836363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123836363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123836378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123836390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123836390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123836390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:39.774818 run osmo-msc_10.42.42.6(pid=9067): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9067)] 12:38:39.822859 run osmo-msc_10.42.42.6(pid=9067): stdout: | (launched: 2022-12-10_12:38:38.578690) 12:38:39.872635 run osmo-msc_10.42.42.6(pid=9067): stderr: | 20221210123838966 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123838966 DLGLOBAL DEBUG validating counter group 0x7f0df7f55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123838966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123838966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123838966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123838967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123838968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123838969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123838969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123838969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:39.923108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9060): Terminating (SIGTERM) 12:38:39.963533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9063): Terminating (SIGTERM) 12:38:40.004224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9066): Terminating (SIGTERM) 12:38:40.045316 --- ParallelTerminationStrategy: PID 9060 died... 12:38:40.064517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9060): Terminated: ok {rc=0} 12:38:40.109756 --- ParallelTerminationStrategy: PID 9063 died... 12:38:40.128562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9063): Terminated: ok {rc=0} 12:38:40.173679 --- ParallelTerminationStrategy: PID 9066 died... 12:38:40.192574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9066): Terminated: ok {rc=0} 12:38:40.277577 bus /sierra_3: Setting Powered False 12:38:41.376523 bus /sierra_3: Setting Powered False 12:38:42.493423 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 12:38:43.767899 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:43.774104 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:38:43.825452 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:38:43.851803 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:38:43.908569 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:38:43.959391 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:38:43.985659 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:38:44.531469 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 12:38:44.536931 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:44.547703 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:38:44.582599 tst handover.py: using LAC 28473 12:38:44.699344 tst handover.py: using RAC 168 12:38:44.813632 tst handover.py: using CellId 28473 12:38:44.938952 tst handover.py: using BVCI 28474 12:38:45.055164 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:38:45.102398 tst handover.py: using LAC 28474 12:38:45.227629 tst handover.py: using RAC 169 12:38:45.350814 tst handover.py: using CellId 28474 12:38:45.466477 tst handover.py: using BVCI 28475 12:38:45.573862 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:45.584637 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:45.595245 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:45.606204 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:45.617320 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:45.628234 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:38:45.745297 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:38:45.863017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:46.375629 run create_hlr_db(pid=9072): Launched 12:38:46.534737 bus /sierra_2: Setting Powered False 12:38:47.594549 run create_hlr_db(pid=9072): Terminated: ok {rc=0} 12:38:48.003988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9074): Launched 12:38:48.323389 run osmo-hlr_10.42.42.2(pid=9075): Launched 12:38:48.445935 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:48.968369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9077): Launched 12:38:49.286690 run osmo-stp_10.42.42.5(pid=9078): Launched 12:38:49.408583 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:49.955286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9080): Launched 12:38:50.273942 run osmo-msc_10.42.42.6(pid=9081): Launched 12:38:50.451384 run osmo-stp_10.42.42.5(pid=9078): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9078)] 12:38:50.587267 run osmo-stp_10.42.42.5(pid=9078): stdout: | (launched: 2022-12-10_12:38:49.228763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:50.721341 run osmo-stp_10.42.42.5(pid=9078): stderr: | 20221210123849419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123849419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123849419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123849420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123849422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123849422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123849422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:50.853532 run osmo-stp_10.42.42.5(pid=9078): stdout: | (launched: 2022-12-10_12:38:49.228763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:50.980301 run osmo-stp_10.42.42.5(pid=9078): stderr: | 20221210123849419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123849419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123849419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123849420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123849422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123849422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123849422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:51.132204 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9078): Process ended prematurely: osmo-stp_10.42.42.5(pid=9078) [trial-2374↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9078)] [trial-2374↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 12:38:51.141060 tst handover.py:18: Test FAILED (6.6 sec) 12:38:51.168216 run osmo-hlr_10.42.42.2(pid=9075): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9075)] 12:38:51.218062 run osmo-hlr_10.42.42.2(pid=9075): stdout: | (launched: 2022-12-10_12:38:48.265983) 12:38:51.269384 run osmo-hlr_10.42.42.2(pid=9075): stderr: | 20221210123848461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123848461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123848461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123848461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123848461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123848461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123848474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123848482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123848483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123848483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:51.341153 run osmo-msc_10.42.42.6(pid=9081): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9081)] 12:38:51.390832 run osmo-msc_10.42.42.6(pid=9081): stdout: | (launched: 2022-12-10_12:38:50.216450) 12:38:51.441885 run osmo-msc_10.42.42.6(pid=9081): stderr: | 20221210123850537 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123850537 DLGLOBAL DEBUG validating counter group 0x7fa6d600ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123850537 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123850537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123850537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123850537 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123850539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123850539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123850540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123850540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:51.493209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9074): Terminating (SIGTERM) 12:38:51.534195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9077): Terminating (SIGTERM) 12:38:51.575446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9080): Terminating (SIGTERM) 12:38:51.616865 --- ParallelTerminationStrategy: PID 9074 died... 12:38:51.636641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9074): Terminated: ok {rc=0} 12:38:51.682340 --- ParallelTerminationStrategy: PID 9077 died... 12:38:51.701678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9077): Terminated: ok {rc=0} 12:38:51.747192 --- ParallelTerminationStrategy: PID 9080 died... 12:38:51.766527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9080): Terminated: ok {rc=0} 12:38:51.853316 bus /sierra_3: Setting Powered False 12:38:52.950878 bus /sierra_3: Setting Powered False 12:38:54.065106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 12:38:55.318491 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:55.325815 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:38:55.376654 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:38:55.403306 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:38:55.454484 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:38:55.504250 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:38:55.530918 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:38:56.078737 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 12:38:56.084272 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:56.095414 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:38:56.130838 tst handover.py: using LAC 28475 12:38:56.255498 tst handover.py: using RAC 170 12:38:56.380574 tst handover.py: using CellId 28475 12:38:56.503146 tst handover.py: using BVCI 28476 12:38:56.617772 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:38:56.665205 tst handover.py: using LAC 28476 12:38:56.788228 tst handover.py: using RAC 171 12:38:56.913707 tst handover.py: using CellId 28476 12:38:57.037941 tst handover.py: using BVCI 28477 12:38:57.153432 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:57.164325 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:57.175230 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:57.186048 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:57.196891 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:57.207770 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:38:57.323689 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:38:57.437175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:57.873053 run create_hlr_db(pid=9088): Launched 12:38:57.988150 bus /sierra_2: Setting Powered False 12:38:59.048490 run create_hlr_db(pid=9088): Terminated: ok {rc=0} 12:38:59.457529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9090): Launched 12:38:59.775542 run osmo-hlr_10.42.42.2(pid=9091): Launched 12:38:59.897275 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:00.418498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9093): Launched 12:39:00.736248 run osmo-stp_10.42.42.5(pid=9094): Launched 12:39:00.859024 run osmo-msc_10.42.42.6: Starting osmo-msc 12:39:01.551843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9096): Launched 12:39:01.895550 run osmo-msc_10.42.42.6(pid=9097): Launched 12:39:02.154196 run osmo-stp_10.42.42.5(pid=9094): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9094)] 12:39:02.310579 run osmo-stp_10.42.42.5(pid=9094): stdout: | (launched: 2022-12-10_12:39:00.678473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:02.455071 run osmo-stp_10.42.42.5(pid=9094): stderr: | 20221210123900905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123900906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123900906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123900906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123900908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123900909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123900909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:02.584608 run osmo-stp_10.42.42.5(pid=9094): stdout: | (launched: 2022-12-10_12:39:00.678473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:02.705390 run osmo-stp_10.42.42.5(pid=9094): stderr: | 20221210123900905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123900906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123900906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123900906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123900908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123900909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123900909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:02.847828 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9094): Process ended prematurely: osmo-stp_10.42.42.5(pid=9094) [trial-2374↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9094)] [trial-2374↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 12:39:02.856312 tst handover.py:18: Test FAILED (6.8 sec) 12:39:02.883382 run osmo-hlr_10.42.42.2(pid=9091): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9091)] 12:39:02.932753 run osmo-hlr_10.42.42.2(pid=9091): stdout: | (launched: 2022-12-10_12:38:59.718347) 12:39:02.983160 run osmo-hlr_10.42.42.2(pid=9091): stderr: | 20221210123859916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123859916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123859916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123859916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123859916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123859916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123859928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123859936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123859937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123859937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:03.053298 run osmo-msc_10.42.42.6(pid=9097): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9097)] 12:39:03.102010 run osmo-msc_10.42.42.6(pid=9097): stdout: | (launched: 2022-12-10_12:39:01.825113) 12:39:03.152341 run osmo-msc_10.42.42.6(pid=9097): stderr: | 20221210123902417 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123902417 DLGLOBAL DEBUG validating counter group 0x7f1b54b74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123902417 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123902417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123902417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123902418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123902419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123902420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123902420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123902420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:03.202943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9090): Terminating (SIGTERM) 12:39:03.243697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9093): Terminating (SIGTERM) 12:39:03.284674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9096): Terminating (SIGTERM) 12:39:03.325961 --- ParallelTerminationStrategy: PID 9090 died... 12:39:03.345296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9090): Terminated: ok {rc=0} 12:39:03.391196 --- ParallelTerminationStrategy: PID 9093 died... 12:39:03.409824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9093): Terminated: ok {rc=0} 12:39:03.455505 --- ParallelTerminationStrategy: PID 9096 died... 12:39:03.474208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9096): Terminated: ok {rc=0} 12:39:03.561389 bus /sierra_3: Setting Powered False 12:39:04.660388 bus /sierra_3: Setting Powered False 12:39:05.775877 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2374 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 12:39:07.026922 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:07.031853 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:39:07.092779 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:39:07.119025 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:39:07.172202 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:39:07.234241 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:39:07.260432 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:39:07.811105 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2374 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 12:39:07.816695 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:39:07.827940 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:39:07.876422 tst handover.py: using LAC 28477 12:39:08.001345 tst handover.py: using RAC 172 12:39:08.125641 tst handover.py: using CellId 28477 12:39:08.250281 tst handover.py: using BVCI 28478 12:39:08.367422 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:39:08.415295 tst handover.py: using LAC 28478 12:39:08.540866 tst handover.py: using RAC 173 12:39:08.665271 tst handover.py: using CellId 28478 12:39:08.789340 tst handover.py: using BVCI 28479 12:39:08.904365 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:39:08.915449 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:39:08.926391 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:39:08.937439 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:39:08.948331 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:39:08.959185 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:39:09.074225 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:39:09.188762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:09.623104 run create_hlr_db(pid=9103): Launched 12:39:09.736823 bus /sierra_2: Setting Powered False 12:39:10.796873 run create_hlr_db(pid=9103): Terminated: ok {rc=0} 12:39:11.203970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Launched 12:39:11.522507 run osmo-hlr_10.42.42.2(pid=9106): Launched 12:39:11.645197 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:12.165463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Launched 12:39:12.484125 run osmo-stp_10.42.42.5(pid=9109): Launched 12:39:12.606969 run osmo-msc_10.42.42.6: Starting osmo-msc 12:39:13.158828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Launched 12:39:13.478153 run osmo-msc_10.42.42.6(pid=9112): Launched 12:39:13.656861 run osmo-stp_10.42.42.5(pid=9109): ERR: Terminated: ERROR {rc=1} [trial-2374↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] 12:39:13.790447 run osmo-stp_10.42.42.5(pid=9109): stdout: | (launched: 2022-12-10_12:39:12.426479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:13.924686 run osmo-stp_10.42.42.5(pid=9109): stderr: | 20221210123912621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123912621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123912621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123912621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123912622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123912622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123912622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:14.058406 run osmo-stp_10.42.42.5(pid=9109): stdout: | (launched: 2022-12-10_12:39:12.426479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:14.185906 run osmo-stp_10.42.42.5(pid=9109): stderr: | 20221210123912621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210123912621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210123912621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210123912621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210123912622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210123912622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210123912622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:14.338116 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9109): Process ended prematurely: osmo-stp_10.42.42.5(pid=9109) [trial-2374↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] [trial-2374↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 12:39:14.346737 tst handover.py:18: Test FAILED (6.5 sec) 12:39:14.374041 run osmo-hlr_10.42.42.2(pid=9106): ERR: Terminated: ERROR {rc=237} [trial-2374↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9106)] 12:39:14.423614 run osmo-hlr_10.42.42.2(pid=9106): stdout: | (launched: 2022-12-10_12:39:11.465022) 12:39:14.474848 run osmo-hlr_10.42.42.2(pid=9106): stderr: | 20221210123911662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210123911662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210123911663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210123911663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210123911663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210123911663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210123911675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210123911683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210123911683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210123911683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:14.546833 run osmo-msc_10.42.42.6(pid=9112): ERR: Terminated: ERROR {rc=2} [trial-2374↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9112)] 12:39:14.596800 run osmo-msc_10.42.42.6(pid=9112): stdout: | (launched: 2022-12-10_12:39:13.420436) 12:39:14.648228 run osmo-msc_10.42.42.6(pid=9112): stderr: | 20221210123913741 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210123913741 DLGLOBAL DEBUG validating counter group 0x7f434de10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210123913741 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210123913741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210123913741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210123913742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210123913743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210123913744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210123913744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210123913744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:14.699879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Terminating (SIGTERM) 12:39:14.741137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Terminating (SIGTERM) 12:39:14.782530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Terminating (SIGTERM) 12:39:14.824167 --- ParallelTerminationStrategy: PID 9105 died... 12:39:14.844016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Terminated: ok {rc=0} 12:39:14.890288 --- ParallelTerminationStrategy: PID 9108 died... 12:39:14.909728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Terminated: ok {rc=0} 12:39:14.955371 --- ParallelTerminationStrategy: PID 9111 died... 12:39:14.974749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Terminated: ok {rc=0} 12:39:15.062346 bus /sierra_3: Setting Powered False 12:39:16.160260 bus /sierra_3: Setting Powered False 12:39:17.276095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2374 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 12:39:18.547039 tst trial-2374: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/trial-2374.xml -------------------------------------------------------------------------------------------- trial-2374 FAIL -------------------------------------------------------------------------------------------- 12:39:20.471795 tst trial-2374: trial-2374: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=1109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1109) [trial-2374↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1109)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.4 sec) Error: osmo-stp_10.42.42.5(pid=1131): Process ended prematurely: osmo-stp_10.42.42.5(pid=1131) [trial-2374↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1131)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1146) [trial-2374↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1146)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1156): Process ended prematurely: osmo-stp_10.42.42.5(pid=1156) [trial-2374↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1156)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1170): Process ended prematurely: osmo-stp_10.42.42.5(pid=1170) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1170)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1183): Process ended prematurely: osmo-stp_10.42.42.5(pid=1183) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1197): Process ended prematurely: osmo-stp_10.42.42.5(pid=1197) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1197)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1208): Process ended prematurely: osmo-stp_10.42.42.5(pid=1208) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1208)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1222): Process ended prematurely: osmo-stp_10.42.42.5(pid=1222) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1222)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1234): Process ended prematurely: osmo-stp_10.42.42.5(pid=1234) [trial-2374↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1234)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1249): Process ended prematurely: osmo-stp_10.42.42.5(pid=1249) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1249)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1261): Process ended prematurely: osmo-stp_10.42.42.5(pid=1261) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1261)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1275): Process ended prematurely: osmo-stp_10.42.42.5(pid=1275) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1275)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1286): Process ended prematurely: osmo-stp_10.42.42.5(pid=1286) [trial-2374↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1286)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1300): Process ended prematurely: osmo-stp_10.42.42.5(pid=1300) [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1300)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1314): Process ended prematurely: osmo-stp_10.42.42.5(pid=1314) [trial-2374↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1314)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1328): Process ended prematurely: osmo-stp_10.42.42.5(pid=1328) [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1328)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1339): Process ended prematurely: osmo-stp_10.42.42.5(pid=1339) [trial-2374↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1339)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1353): Process ended prematurely: osmo-stp_10.42.42.5(pid=1353) [trial-2374↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1353)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1364): Process ended prematurely: osmo-stp_10.42.42.5(pid=1364) [trial-2374↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1364)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=1382): Process ended prematurely: osmo-stp_10.42.42.5(pid=1382) [trial-2374↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1382)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1395): Process ended prematurely: osmo-stp_10.42.42.5(pid=1395) [trial-2374↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1395)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=1413): Process ended prematurely: osmo-stp_10.42.42.5(pid=1413) [trial-2374↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1413)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1423): Process ended prematurely: osmo-stp_10.42.42.5(pid=1423) [trial-2374↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1423)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1433): Process ended prematurely: osmo-stp_10.42.42.5(pid=1433) [trial-2374↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=1451): Process ended prematurely: osmo-stp_10.42.42.5(pid=1451) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1451)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1463): Process ended prematurely: osmo-stp_10.42.42.5(pid=1463) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=1481): Process ended prematurely: osmo-stp_10.42.42.5(pid=1481) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1481)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1492): Process ended prematurely: osmo-stp_10.42.42.5(pid=1492) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1492)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1502): Process ended prematurely: osmo-stp_10.42.42.5(pid=1502) [trial-2374↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1502)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1519): Process ended prematurely: osmo-stp_10.42.42.5(pid=1519) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] FAIL: iperf3.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=1804): Process ended prematurely: osmo-stp_10.42.42.5(pid=1804) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1804)] FAIL: iperf3m4.py (12.2 sec) Error: osmo-stp_10.42.42.5(pid=1824): Process ended prematurely: osmo-stp_10.42.42.5(pid=1824) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1824)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1834): Process ended prematurely: osmo-stp_10.42.42.5(pid=1834) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1834)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1844): Process ended prematurely: osmo-stp_10.42.42.5(pid=1844) [trial-2374↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1844)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=1863): Process ended prematurely: osmo-stp_10.42.42.5(pid=1863) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1863)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1923): Process ended prematurely: osmo-stp_10.42.42.5(pid=1923) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1923)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=1944): Process ended prematurely: osmo-stp_10.42.42.5(pid=1944) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1944)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1955): Process ended prematurely: osmo-stp_10.42.42.5(pid=1955) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=1969): Process ended prematurely: osmo-stp_10.42.42.5(pid=1969) [trial-2374↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1969)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1982): Process ended prematurely: osmo-stp_10.42.42.5(pid=1982) [trial-2374↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1982)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2374↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2004): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2004) [trial-2374↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2004)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2014): Process ended prematurely: osmo-stp_10.42.42.5(pid=2014) [trial-2374↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2014)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2023) [trial-2374↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2023)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2033): Process ended prematurely: osmo-stp_10.42.42.5(pid=2033) [trial-2374↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2047): Process ended prematurely: osmo-stp_10.42.42.5(pid=2047) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2047)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2058): Process ended prematurely: osmo-stp_10.42.42.5(pid=2058) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2072): Process ended prematurely: osmo-stp_10.42.42.5(pid=2072) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2072)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2083): Process ended prematurely: osmo-stp_10.42.42.5(pid=2083) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2083)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2097): Process ended prematurely: osmo-stp_10.42.42.5(pid=2097) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2097)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2108): Process ended prematurely: osmo-stp_10.42.42.5(pid=2108) [trial-2374↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2108)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2122): Process ended prematurely: osmo-stp_10.42.42.5(pid=2122) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2122)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2133): Process ended prematurely: osmo-stp_10.42.42.5(pid=2133) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2133)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2148): Process ended prematurely: osmo-stp_10.42.42.5(pid=2148) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2148)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2162): Process ended prematurely: osmo-stp_10.42.42.5(pid=2162) [trial-2374↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2162)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2176): Process ended prematurely: osmo-stp_10.42.42.5(pid=2176) [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2176)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2187): Process ended prematurely: osmo-stp_10.42.42.5(pid=2187) [trial-2374↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2187)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2201): Process ended prematurely: osmo-stp_10.42.42.5(pid=2201) [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2201)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2212): Process ended prematurely: osmo-stp_10.42.42.5(pid=2212) [trial-2374↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2212)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2226): Process ended prematurely: osmo-stp_10.42.42.5(pid=2226) [trial-2374↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2226)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2237): Process ended prematurely: osmo-stp_10.42.42.5(pid=2237) [trial-2374↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2237)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=2255): Process ended prematurely: osmo-stp_10.42.42.5(pid=2255) [trial-2374↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2267): Process ended prematurely: osmo-stp_10.42.42.5(pid=2267) [trial-2374↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2267)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=2285): Process ended prematurely: osmo-stp_10.42.42.5(pid=2285) [trial-2374↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2285)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2296): Process ended prematurely: osmo-stp_10.42.42.5(pid=2296) [trial-2374↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2296)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2306): Process ended prematurely: osmo-stp_10.42.42.5(pid=2306) [trial-2374↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2306)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=2326): Process ended prematurely: osmo-stp_10.42.42.5(pid=2326) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2326)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2338): Process ended prematurely: osmo-stp_10.42.42.5(pid=2338) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=2356): Process ended prematurely: osmo-stp_10.42.42.5(pid=2356) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2356)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2366): Process ended prematurely: osmo-stp_10.42.42.5(pid=2366) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2366)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2376): Process ended prematurely: osmo-stp_10.42.42.5(pid=2376) [trial-2374↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=2395): Process ended prematurely: osmo-stp_10.42.42.5(pid=2395) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2395)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2407): Process ended prematurely: osmo-stp_10.42.42.5(pid=2407) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2407)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=2425): Process ended prematurely: osmo-stp_10.42.42.5(pid=2425) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2425)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2435): Process ended prematurely: osmo-stp_10.42.42.5(pid=2435) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2435)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2445): Process ended prematurely: osmo-stp_10.42.42.5(pid=2445) [trial-2374↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2445)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=2463): Process ended prematurely: osmo-stp_10.42.42.5(pid=2463) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2463)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=2475): Process ended prematurely: osmo-stp_10.42.42.5(pid=2475) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2475)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=2493): Process ended prematurely: osmo-stp_10.42.42.5(pid=2493) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2503): Process ended prematurely: osmo-stp_10.42.42.5(pid=2503) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2503)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2513): Process ended prematurely: osmo-stp_10.42.42.5(pid=2513) [trial-2374↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2527): Process ended prematurely: osmo-stp_10.42.42.5(pid=2527) [trial-2374↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2527)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2540): Process ended prematurely: osmo-stp_10.42.42.5(pid=2540) [trial-2374↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2540)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2548) [trial-2374↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2548)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2558): Process ended prematurely: osmo-stp_10.42.42.5(pid=2558) [trial-2374↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2558)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=2567): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2567) [trial-2374↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2567)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2577): Process ended prematurely: osmo-stp_10.42.42.5(pid=2577) [trial-2374↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2577)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2591): Process ended prematurely: osmo-stp_10.42.42.5(pid=2591) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2602): Process ended prematurely: osmo-stp_10.42.42.5(pid=2602) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2602)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2616): Process ended prematurely: osmo-stp_10.42.42.5(pid=2616) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2616)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2627): Process ended prematurely: osmo-stp_10.42.42.5(pid=2627) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2627)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2641): Process ended prematurely: osmo-stp_10.42.42.5(pid=2641) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2641)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2653): Process ended prematurely: osmo-stp_10.42.42.5(pid=2653) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2653)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2667): Process ended prematurely: osmo-stp_10.42.42.5(pid=2667) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2667)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2681): Process ended prematurely: osmo-stp_10.42.42.5(pid=2681) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2681)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2695): Process ended prematurely: osmo-stp_10.42.42.5(pid=2695) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2695)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2706): Process ended prematurely: osmo-stp_10.42.42.5(pid=2706) [trial-2374↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2706)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2720): Process ended prematurely: osmo-stp_10.42.42.5(pid=2720) [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2720)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2731): Process ended prematurely: osmo-stp_10.42.42.5(pid=2731) [trial-2374↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2731)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2745): Process ended prematurely: osmo-stp_10.42.42.5(pid=2745) [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2745)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2756): Process ended prematurely: osmo-stp_10.42.42.5(pid=2756) [trial-2374↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2756)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2770): Process ended prematurely: osmo-stp_10.42.42.5(pid=2770) [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2770)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2781): Process ended prematurely: osmo-stp_10.42.42.5(pid=2781) [trial-2374↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2781)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2795): Process ended prematurely: osmo-stp_10.42.42.5(pid=2795) [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2795)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2806): Process ended prematurely: osmo-stp_10.42.42.5(pid=2806) [trial-2374↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2821): Process ended prematurely: osmo-stp_10.42.42.5(pid=2821) [trial-2374↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2821)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2832): Process ended prematurely: osmo-stp_10.42.42.5(pid=2832) [trial-2374↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=2855): Process ended prematurely: osmo-stp_10.42.42.5(pid=2855) [trial-2374↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2855)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2867): Process ended prematurely: osmo-stp_10.42.42.5(pid=2867) [trial-2374↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2867)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=2885): Process ended prematurely: osmo-stp_10.42.42.5(pid=2885) [trial-2374↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2885)] FAIL: ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3065): Process ended prematurely: osmo-stp_10.42.42.5(pid=3065) [trial-2374↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3065)] FAIL: ping_idle_ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=3179): Process ended prematurely: osmo-stp_10.42.42.5(pid=3179) [trial-2374↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3179)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=3196): Process ended prematurely: osmo-stp_10.42.42.5(pid=3196) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3196)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3208): Process ended prematurely: osmo-stp_10.42.42.5(pid=3208) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3208)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=3226): Process ended prematurely: osmo-stp_10.42.42.5(pid=3226) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3226)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3236): Process ended prematurely: osmo-stp_10.42.42.5(pid=3236) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3236)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3246): Process ended prematurely: osmo-stp_10.42.42.5(pid=3246) [trial-2374↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3246)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=3263): Process ended prematurely: osmo-stp_10.42.42.5(pid=3263) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3263)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=3275): Process ended prematurely: osmo-stp_10.42.42.5(pid=3275) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3275)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=3297): Process ended prematurely: osmo-stp_10.42.42.5(pid=3297) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3297)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3307): Process ended prematurely: osmo-stp_10.42.42.5(pid=3307) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3307)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3317): Process ended prematurely: osmo-stp_10.42.42.5(pid=3317) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3317)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3334): Process ended prematurely: osmo-stp_10.42.42.5(pid=3334) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3334)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=3346): Process ended prematurely: osmo-stp_10.42.42.5(pid=3346) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3346)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=3364): Process ended prematurely: osmo-stp_10.42.42.5(pid=3364) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3364)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3374): Process ended prematurely: osmo-stp_10.42.42.5(pid=3374) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3374)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3384): Process ended prematurely: osmo-stp_10.42.42.5(pid=3384) [trial-2374↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3384)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=3401): Process ended prematurely: osmo-stp_10.42.42.5(pid=3401) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3401)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=3413): Process ended prematurely: osmo-stp_10.42.42.5(pid=3413) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3413)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=3438): Process ended prematurely: osmo-stp_10.42.42.5(pid=3438) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3438)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3448): Process ended prematurely: osmo-stp_10.42.42.5(pid=3448) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3448)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3458): Process ended prematurely: osmo-stp_10.42.42.5(pid=3458) [trial-2374↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3458)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3472): Process ended prematurely: osmo-stp_10.42.42.5(pid=3472) [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3472)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3485): Process ended prematurely: osmo-stp_10.42.42.5(pid=3485) [trial-2374↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3485)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3493): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3493) [trial-2374↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3493)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3503): Process ended prematurely: osmo-stp_10.42.42.5(pid=3503) [trial-2374↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3503)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=3513): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3513) [trial-2374↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3513)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=3523): Process ended prematurely: osmo-stp_10.42.42.5(pid=3523) [trial-2374↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3523)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3537): Process ended prematurely: osmo-stp_10.42.42.5(pid=3537) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3537)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3563): Process ended prematurely: osmo-stp_10.42.42.5(pid=3563) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3563)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3588): Process ended prematurely: osmo-stp_10.42.42.5(pid=3588) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3599): Process ended prematurely: osmo-stp_10.42.42.5(pid=3599) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3599)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3614): Process ended prematurely: osmo-stp_10.42.42.5(pid=3614) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3614)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3625): Process ended prematurely: osmo-stp_10.42.42.5(pid=3625) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3625)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3639): Process ended prematurely: osmo-stp_10.42.42.5(pid=3639) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3639)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3653): Process ended prematurely: osmo-stp_10.42.42.5(pid=3653) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3653)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3668): Process ended prematurely: osmo-stp_10.42.42.5(pid=3668) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3668)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3679): Process ended prematurely: osmo-stp_10.42.42.5(pid=3679) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3679)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3693): Process ended prematurely: osmo-stp_10.42.42.5(pid=3693) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3693)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3704): Process ended prematurely: osmo-stp_10.42.42.5(pid=3704) [trial-2374↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3704)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3720): Process ended prematurely: osmo-stp_10.42.42.5(pid=3720) [trial-2374↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3720)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3731): Process ended prematurely: osmo-stp_10.42.42.5(pid=3731) [trial-2374↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3731)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=3749): Process ended prematurely: osmo-stp_10.42.42.5(pid=3749) [trial-2374↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3749)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3761): Process ended prematurely: osmo-stp_10.42.42.5(pid=3761) [trial-2374↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3761)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=3779): Process ended prematurely: osmo-stp_10.42.42.5(pid=3779) [trial-2374↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3779)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3789): Process ended prematurely: osmo-stp_10.42.42.5(pid=3789) [trial-2374↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3789)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3799): Process ended prematurely: osmo-stp_10.42.42.5(pid=3799) [trial-2374↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3799)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=3816): Process ended prematurely: osmo-stp_10.42.42.5(pid=3816) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3816)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3833): Process ended prematurely: osmo-stp_10.42.42.5(pid=3833) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3833)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=3852): Process ended prematurely: osmo-stp_10.42.42.5(pid=3852) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3852)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3862): Process ended prematurely: osmo-stp_10.42.42.5(pid=3862) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3862)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3872): Process ended prematurely: osmo-stp_10.42.42.5(pid=3872) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3872)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=3889): Process ended prematurely: osmo-stp_10.42.42.5(pid=3889) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3889)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3901): Process ended prematurely: osmo-stp_10.42.42.5(pid=3901) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3901)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=3919): Process ended prematurely: osmo-stp_10.42.42.5(pid=3919) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3919)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3929): Process ended prematurely: osmo-stp_10.42.42.5(pid=3929) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3929)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3939): Process ended prematurely: osmo-stp_10.42.42.5(pid=3939) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3939)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3958): Process ended prematurely: osmo-stp_10.42.42.5(pid=3958) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3958)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3970): Process ended prematurely: osmo-stp_10.42.42.5(pid=3970) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3970)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=3989): Process ended prematurely: osmo-stp_10.42.42.5(pid=3989) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4002): Process ended prematurely: osmo-stp_10.42.42.5(pid=4002) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4002)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4012): Process ended prematurely: osmo-stp_10.42.42.5(pid=4012) [trial-2374↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4012)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4025): Process ended prematurely: osmo-stp_10.42.42.5(pid=4025) [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4025)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4039): Process ended prematurely: osmo-stp_10.42.42.5(pid=4039) [trial-2374↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4039)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=4048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4048) [trial-2374↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4048)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4058): Process ended prematurely: osmo-stp_10.42.42.5(pid=4058) [trial-2374↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4067) [trial-2374↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4067)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4077): Process ended prematurely: osmo-stp_10.42.42.5(pid=4077) [trial-2374↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4077)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4091): Process ended prematurely: osmo-stp_10.42.42.5(pid=4091) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4091)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4102): Process ended prematurely: osmo-stp_10.42.42.5(pid=4102) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4102)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4116): Process ended prematurely: osmo-stp_10.42.42.5(pid=4116) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4116)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4127): Process ended prematurely: osmo-stp_10.42.42.5(pid=4127) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4127)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4141): Process ended prematurely: osmo-stp_10.42.42.5(pid=4141) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4141)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4152): Process ended prematurely: osmo-stp_10.42.42.5(pid=4152) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4152)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4166): Process ended prematurely: osmo-stp_10.42.42.5(pid=4166) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4166)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4177): Process ended prematurely: osmo-stp_10.42.42.5(pid=4177) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4177)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4193): Process ended prematurely: osmo-stp_10.42.42.5(pid=4193) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4204): Process ended prematurely: osmo-stp_10.42.42.5(pid=4204) [trial-2374↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4204)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4218): Process ended prematurely: osmo-stp_10.42.42.5(pid=4218) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4218)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4320): Process ended prematurely: osmo-stp_10.42.42.5(pid=4320) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4320)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4514): Process ended prematurely: osmo-stp_10.42.42.5(pid=4514) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4514)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4526): Process ended prematurely: osmo-stp_10.42.42.5(pid=4526) [trial-2374↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4526)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4540): Process ended prematurely: osmo-stp_10.42.42.5(pid=4540) [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4551): Process ended prematurely: osmo-stp_10.42.42.5(pid=4551) [trial-2374↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4551)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2374↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4576): Process ended prematurely: osmo-stp_10.42.42.5(pid=4576) [trial-2374↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4576)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=4594): Process ended prematurely: osmo-stp_10.42.42.5(pid=4594) [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4606): Process ended prematurely: osmo-stp_10.42.42.5(pid=4606) [trial-2374↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=4627): Process ended prematurely: osmo-stp_10.42.42.5(pid=4627) [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4627)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4637): Process ended prematurely: osmo-stp_10.42.42.5(pid=4637) [trial-2374↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4637)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4648): Process ended prematurely: osmo-stp_10.42.42.5(pid=4648) [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4667): Process ended prematurely: osmo-stp_10.42.42.5(pid=4667) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4667)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=4679): Process ended prematurely: osmo-stp_10.42.42.5(pid=4679) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4679)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4697): Process ended prematurely: osmo-stp_10.42.42.5(pid=4697) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4697)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4707): Process ended prematurely: osmo-stp_10.42.42.5(pid=4707) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4717): Process ended prematurely: osmo-stp_10.42.42.5(pid=4717) [trial-2374↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4717)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4734): Process ended prematurely: osmo-stp_10.42.42.5(pid=4734) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4734)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4746): Process ended prematurely: osmo-stp_10.42.42.5(pid=4746) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4746)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=4764): Process ended prematurely: osmo-stp_10.42.42.5(pid=4764) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4764)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4774): Process ended prematurely: osmo-stp_10.42.42.5(pid=4774) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4774)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4784): Process ended prematurely: osmo-stp_10.42.42.5(pid=4784) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4784)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=4804): Process ended prematurely: osmo-stp_10.42.42.5(pid=4804) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4816): Process ended prematurely: osmo-stp_10.42.42.5(pid=4816) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4816)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=4834): Process ended prematurely: osmo-stp_10.42.42.5(pid=4834) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4834)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4844): Process ended prematurely: osmo-stp_10.42.42.5(pid=4844) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4844)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4854): Process ended prematurely: osmo-stp_10.42.42.5(pid=4854) [trial-2374↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4854)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=4871): Process ended prematurely: osmo-stp_10.42.42.5(pid=4871) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4871)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4884): Process ended prematurely: osmo-stp_10.42.42.5(pid=4884) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4884)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=4902): Process ended prematurely: osmo-stp_10.42.42.5(pid=4902) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4902)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4912): Process ended prematurely: osmo-stp_10.42.42.5(pid=4912) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4912)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4922): Process ended prematurely: osmo-stp_10.42.42.5(pid=4922) [trial-2374↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4922)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4936): Process ended prematurely: osmo-stp_10.42.42.5(pid=4936) [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4949): Process ended prematurely: osmo-stp_10.42.42.5(pid=4949) [trial-2374↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4949)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4957): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4957) [trial-2374↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4957)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5017): Process ended prematurely: osmo-stp_10.42.42.5(pid=5017) [trial-2374↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5017)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5379): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5379) [trial-2374↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5379)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5565): Process ended prematurely: osmo-stp_10.42.42.5(pid=5565) [trial-2374↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5565)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5580): Process ended prematurely: osmo-stp_10.42.42.5(pid=5580) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5580)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5591): Process ended prematurely: osmo-stp_10.42.42.5(pid=5591) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5591)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5605): Process ended prematurely: osmo-stp_10.42.42.5(pid=5605) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5605)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5616): Process ended prematurely: osmo-stp_10.42.42.5(pid=5616) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5616)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5630): Process ended prematurely: osmo-stp_10.42.42.5(pid=5630) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5630)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5641): Process ended prematurely: osmo-stp_10.42.42.5(pid=5641) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5641)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5656): Process ended prematurely: osmo-stp_10.42.42.5(pid=5656) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5656)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5667): Process ended prematurely: osmo-stp_10.42.42.5(pid=5667) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5667)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5681): Process ended prematurely: osmo-stp_10.42.42.5(pid=5681) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5681)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5692): Process ended prematurely: osmo-stp_10.42.42.5(pid=5692) [trial-2374↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5706): Process ended prematurely: osmo-stp_10.42.42.5(pid=5706) [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5706)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5717): Process ended prematurely: osmo-stp_10.42.42.5(pid=5717) [trial-2374↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5717)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5734): Process ended prematurely: osmo-stp_10.42.42.5(pid=5734) [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5734)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5745): Process ended prematurely: osmo-stp_10.42.42.5(pid=5745) [trial-2374↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5745)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5760): Process ended prematurely: osmo-stp_10.42.42.5(pid=5760) [trial-2374↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5760)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5771): Process ended prematurely: osmo-stp_10.42.42.5(pid=5771) [trial-2374↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5771)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5789): Process ended prematurely: osmo-stp_10.42.42.5(pid=5789) [trial-2374↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5789)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5801): Process ended prematurely: osmo-stp_10.42.42.5(pid=5801) [trial-2374↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5801)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=5819): Process ended prematurely: osmo-stp_10.42.42.5(pid=5819) [trial-2374↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5819)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5831): Process ended prematurely: osmo-stp_10.42.42.5(pid=5831) [trial-2374↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5831)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5841): Process ended prematurely: osmo-stp_10.42.42.5(pid=5841) [trial-2374↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5841)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5858): Process ended prematurely: osmo-stp_10.42.42.5(pid=5858) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5858)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=5875): Process ended prematurely: osmo-stp_10.42.42.5(pid=5875) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5875)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=5893): Process ended prematurely: osmo-stp_10.42.42.5(pid=5893) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5893)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5907): Process ended prematurely: osmo-stp_10.42.42.5(pid=5907) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5907)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5917): Process ended prematurely: osmo-stp_10.42.42.5(pid=5917) [trial-2374↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5917)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5934): Process ended prematurely: osmo-stp_10.42.42.5(pid=5934) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5934)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=5946): Process ended prematurely: osmo-stp_10.42.42.5(pid=5946) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5946)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=5964): Process ended prematurely: osmo-stp_10.42.42.5(pid=5964) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5964)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5974): Process ended prematurely: osmo-stp_10.42.42.5(pid=5974) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5974)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5984): Process ended prematurely: osmo-stp_10.42.42.5(pid=5984) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5984)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6001): Process ended prematurely: osmo-stp_10.42.42.5(pid=6001) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6001)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6015): Process ended prematurely: osmo-stp_10.42.42.5(pid=6015) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6015)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=6033): Process ended prematurely: osmo-stp_10.42.42.5(pid=6033) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6033)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6054): Process ended prematurely: osmo-stp_10.42.42.5(pid=6054) [trial-2374↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6054)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6068): Process ended prematurely: osmo-stp_10.42.42.5(pid=6068) [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6068)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6082): Process ended prematurely: osmo-stp_10.42.42.5(pid=6082) [trial-2374↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6082)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=6090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6090) [trial-2374↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6090)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6101): Process ended prematurely: osmo-stp_10.42.42.5(pid=6101) [trial-2374↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6101)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6110): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6110) [trial-2374↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6110)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6120): Process ended prematurely: osmo-stp_10.42.42.5(pid=6120) [trial-2374↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6120)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=6407): Process ended prematurely: osmo-stp_10.42.42.5(pid=6407) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6407)] FAIL: mo_mt_call_osmux.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=6418): Process ended prematurely: osmo-stp_10.42.42.5(pid=6418) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6418)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6432): Process ended prematurely: osmo-stp_10.42.42.5(pid=6432) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6443): Process ended prematurely: osmo-stp_10.42.42.5(pid=6443) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6443)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6457): Process ended prematurely: osmo-stp_10.42.42.5(pid=6457) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6457)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6469): Process ended prematurely: osmo-stp_10.42.42.5(pid=6469) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6469)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6483): Process ended prematurely: osmo-stp_10.42.42.5(pid=6483) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6483)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6494): Process ended prematurely: osmo-stp_10.42.42.5(pid=6494) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6494)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6508): Process ended prematurely: osmo-stp_10.42.42.5(pid=6508) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6508)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6522): Process ended prematurely: osmo-stp_10.42.42.5(pid=6522) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6522)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6537): Process ended prematurely: osmo-stp_10.42.42.5(pid=6537) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6537)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6548): Process ended prematurely: osmo-stp_10.42.42.5(pid=6548) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6548)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6562): Process ended prematurely: osmo-stp_10.42.42.5(pid=6562) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6573): Process ended prematurely: osmo-stp_10.42.42.5(pid=6573) [trial-2374↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6588): Process ended prematurely: osmo-stp_10.42.42.5(pid=6588) [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6588)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6599): Process ended prematurely: osmo-stp_10.42.42.5(pid=6599) [trial-2374↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6599)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=6617): Process ended prematurely: osmo-stp_10.42.42.5(pid=6617) [trial-2374↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6617)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6629): Process ended prematurely: osmo-stp_10.42.42.5(pid=6629) [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=6647): Process ended prematurely: osmo-stp_10.42.42.5(pid=6647) [trial-2374↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6647)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6657): Process ended prematurely: osmo-stp_10.42.42.5(pid=6657) [trial-2374↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6657)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6667): Process ended prematurely: osmo-stp_10.42.42.5(pid=6667) [trial-2374↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6667)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6684): Process ended prematurely: osmo-stp_10.42.42.5(pid=6684) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6684)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6698): Process ended prematurely: osmo-stp_10.42.42.5(pid=6698) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6698)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=6716): Process ended prematurely: osmo-stp_10.42.42.5(pid=6716) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6716)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6726): Process ended prematurely: osmo-stp_10.42.42.5(pid=6726) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6726)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6736): Process ended prematurely: osmo-stp_10.42.42.5(pid=6736) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6736)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=6753): Process ended prematurely: osmo-stp_10.42.42.5(pid=6753) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6753)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=6766): Process ended prematurely: osmo-stp_10.42.42.5(pid=6766) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6766)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6784): Process ended prematurely: osmo-stp_10.42.42.5(pid=6784) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6784)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6794): Process ended prematurely: osmo-stp_10.42.42.5(pid=6794) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6794)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6804): Process ended prematurely: osmo-stp_10.42.42.5(pid=6804) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6804)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=6821): Process ended prematurely: osmo-stp_10.42.42.5(pid=6821) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6821)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6834): Process ended prematurely: osmo-stp_10.42.42.5(pid=6834) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6834)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6852): Process ended prematurely: osmo-stp_10.42.42.5(pid=6852) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6852)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6865): Process ended prematurely: osmo-stp_10.42.42.5(pid=6865) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6865)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6875): Process ended prematurely: osmo-stp_10.42.42.5(pid=6875) [trial-2374↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6875)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6889): Process ended prematurely: osmo-stp_10.42.42.5(pid=6889) [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6889)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6902): Process ended prematurely: osmo-stp_10.42.42.5(pid=6902) [trial-2374↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6902)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6911): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6911) [trial-2374↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6911)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=6922): Process ended prematurely: osmo-stp_10.42.42.5(pid=6922) [trial-2374↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6922)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6932): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6932) [trial-2374↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6932)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=6942): Process ended prematurely: osmo-stp_10.42.42.5(pid=6942) [trial-2374↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6942)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6956): Process ended prematurely: osmo-stp_10.42.42.5(pid=6956) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6956)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6967): Process ended prematurely: osmo-stp_10.42.42.5(pid=6967) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6981): Process ended prematurely: osmo-stp_10.42.42.5(pid=6981) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6981)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6992): Process ended prematurely: osmo-stp_10.42.42.5(pid=6992) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7006): Process ended prematurely: osmo-stp_10.42.42.5(pid=7006) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7006)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7020): Process ended prematurely: osmo-stp_10.42.42.5(pid=7020) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7020)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7034): Process ended prematurely: osmo-stp_10.42.42.5(pid=7034) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7034)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7045): Process ended prematurely: osmo-stp_10.42.42.5(pid=7045) [trial-2374↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7045)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7059): Process ended prematurely: osmo-stp_10.42.42.5(pid=7059) [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7059)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7070): Process ended prematurely: osmo-stp_10.42.42.5(pid=7070) [trial-2374↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7070)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7085): Process ended prematurely: osmo-stp_10.42.42.5(pid=7085) [trial-2374↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7085)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7096): Process ended prematurely: osmo-stp_10.42.42.5(pid=7096) [trial-2374↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7096)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=7114): Process ended prematurely: osmo-stp_10.42.42.5(pid=7114) [trial-2374↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7114)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7126): Process ended prematurely: osmo-stp_10.42.42.5(pid=7126) [trial-2374↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7126)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7144): Process ended prematurely: osmo-stp_10.42.42.5(pid=7144) [trial-2374↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7144)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7154): Process ended prematurely: osmo-stp_10.42.42.5(pid=7154) [trial-2374↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7154)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7164): Process ended prematurely: osmo-stp_10.42.42.5(pid=7164) [trial-2374↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7164)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=7182): Process ended prematurely: osmo-stp_10.42.42.5(pid=7182) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7182)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7195): Process ended prematurely: osmo-stp_10.42.42.5(pid=7195) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7195)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=7213): Process ended prematurely: osmo-stp_10.42.42.5(pid=7213) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7213)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7226): Process ended prematurely: osmo-stp_10.42.42.5(pid=7226) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7226)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7236): Process ended prematurely: osmo-stp_10.42.42.5(pid=7236) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7236)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=7253): Process ended prematurely: osmo-stp_10.42.42.5(pid=7253) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7253)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=7265): Process ended prematurely: osmo-stp_10.42.42.5(pid=7265) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7265)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=7283): Process ended prematurely: osmo-stp_10.42.42.5(pid=7283) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7283)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7293): Process ended prematurely: osmo-stp_10.42.42.5(pid=7293) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7293)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7303): Process ended prematurely: osmo-stp_10.42.42.5(pid=7303) [trial-2374↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7303)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7317): Process ended prematurely: osmo-stp_10.42.42.5(pid=7317) [trial-2374↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7317)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7331): Process ended prematurely: osmo-stp_10.42.42.5(pid=7331) [trial-2374↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7331)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7340): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7340) [trial-2374↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7340)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=7350): Process ended prematurely: osmo-stp_10.42.42.5(pid=7350) [trial-2374↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7364): Process ended prematurely: osmo-stp_10.42.42.5(pid=7364) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7364)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7375): Process ended prematurely: osmo-stp_10.42.42.5(pid=7375) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7389): Process ended prematurely: osmo-stp_10.42.42.5(pid=7389) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7389)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7400): Process ended prematurely: osmo-stp_10.42.42.5(pid=7400) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7400)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7415): Process ended prematurely: osmo-stp_10.42.42.5(pid=7415) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7415)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7426): Process ended prematurely: osmo-stp_10.42.42.5(pid=7426) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7426)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7441): Process ended prematurely: osmo-stp_10.42.42.5(pid=7441) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7441)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7452): Process ended prematurely: osmo-stp_10.42.42.5(pid=7452) [trial-2374↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7452)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=7737): Process ended prematurely: osmo-stp_10.42.42.5(pid=7737) [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7737)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7748): Process ended prematurely: osmo-stp_10.42.42.5(pid=7748) [trial-2374↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7748)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7763): Process ended prematurely: osmo-stp_10.42.42.5(pid=7763) [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7763)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7774): Process ended prematurely: osmo-stp_10.42.42.5(pid=7774) [trial-2374↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7774)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7788): Process ended prematurely: osmo-stp_10.42.42.5(pid=7788) [trial-2374↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7788)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7799): Process ended prematurely: osmo-stp_10.42.42.5(pid=7799) [trial-2374↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7799)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7817): Process ended prematurely: osmo-stp_10.42.42.5(pid=7817) [trial-2374↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7817)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7830): Process ended prematurely: osmo-stp_10.42.42.5(pid=7830) [trial-2374↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7830)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=7851): Process ended prematurely: osmo-stp_10.42.42.5(pid=7851) [trial-2374↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7851)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7861): Process ended prematurely: osmo-stp_10.42.42.5(pid=7861) [trial-2374↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7861)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7871): Process ended prematurely: osmo-stp_10.42.42.5(pid=7871) [trial-2374↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7871)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=7890): Process ended prematurely: osmo-stp_10.42.42.5(pid=7890) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7890)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7902): Process ended prematurely: osmo-stp_10.42.42.5(pid=7902) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7902)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=7920): Process ended prematurely: osmo-stp_10.42.42.5(pid=7920) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7920)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7930): Process ended prematurely: osmo-stp_10.42.42.5(pid=7930) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7930)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7940): Process ended prematurely: osmo-stp_10.42.42.5(pid=7940) [trial-2374↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7940)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7957): Process ended prematurely: osmo-stp_10.42.42.5(pid=7957) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7957)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7969): Process ended prematurely: osmo-stp_10.42.42.5(pid=7969) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7969)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7987): Process ended prematurely: osmo-stp_10.42.42.5(pid=7987) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7987)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7998): Process ended prematurely: osmo-stp_10.42.42.5(pid=7998) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7998)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8008): Process ended prematurely: osmo-stp_10.42.42.5(pid=8008) [trial-2374↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=8027): Process ended prematurely: osmo-stp_10.42.42.5(pid=8027) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8027)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8039): Process ended prematurely: osmo-stp_10.42.42.5(pid=8039) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8039)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=8057): Process ended prematurely: osmo-stp_10.42.42.5(pid=8057) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8057)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8067): Process ended prematurely: osmo-stp_10.42.42.5(pid=8067) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8067)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8077): Process ended prematurely: osmo-stp_10.42.42.5(pid=8077) [trial-2374↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8077)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8090): Process ended prematurely: osmo-stp_10.42.42.5(pid=8090) [trial-2374↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8090)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=8098): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8098) [trial-2374↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8098)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=8100): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8100) [trial-2374↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8100)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=8102): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8102) [trial-2374↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8102)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=8105): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8105) [trial-2374↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8105)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=8114): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8114) [trial-2374↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8114)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=8125): Process ended prematurely: osmo-hlr_10.42.42.2(pid=8125) [trial-2374↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8125)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=8137): Process ended prematurely: osmo-stp_10.42.42.5(pid=8137) [trial-2374↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8137)] FAIL: esme_ms_sms_transaction.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=8148): Process ended prematurely: osmo-stp_10.42.42.5(pid=8148) [trial-2374↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8148)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8162): Process ended prematurely: osmo-stp_10.42.42.5(pid=8162) [trial-2374↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8162)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8173): Process ended prematurely: osmo-stp_10.42.42.5(pid=8173) [trial-2374↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8173)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8184): Process ended prematurely: osmo-stp_10.42.42.5(pid=8184) [trial-2374↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8184)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8195): Process ended prematurely: osmo-stp_10.42.42.5(pid=8195) [trial-2374↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8195)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.0 sec) Error: srsepc(pid=8221): Process ended prematurely: srsepc(pid=8221) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8221)] FAIL: iperf3_bidir.py (18.6 sec) Error: srsepc(pid=8237): Process ended prematurely: srsepc(pid=8237) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8237)] FAIL: iperf3_dl.py (18.5 sec) Error: srsepc(pid=8253): Process ended prematurely: srsepc(pid=8253) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8253)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=8270): Process ended prematurely: srsepc(pid=8270) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8270)] FAIL: ping.py (18.2 sec) Error: srsepc(pid=8286): Process ended prematurely: srsepc(pid=8286) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8286)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=8302): Process ended prematurely: srsepc(pid=8302) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8302)] FAIL: rrc_idle_mt_ping.py (18.5 sec) Error: srsepc(pid=8318): Process ended prematurely: srsepc(pid=8318) [trial-2374↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8318)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8336): Process ended prematurely: osmo-stp_10.42.42.5(pid=8336) [trial-2374↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8350): Process ended prematurely: osmo-stp_10.42.42.5(pid=8350) [trial-2374↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8364): Process ended prematurely: osmo-stp_10.42.42.5(pid=8364) [trial-2374↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8364)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8379): Process ended prematurely: osmo-stp_10.42.42.5(pid=8379) [trial-2374↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8379)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8394): Process ended prematurely: osmo-stp_10.42.42.5(pid=8394) [trial-2374↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8394)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8408): Process ended prematurely: osmo-stp_10.42.42.5(pid=8408) [trial-2374↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8408)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8422): Process ended prematurely: osmo-stp_10.42.42.5(pid=8422) [trial-2374↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8422)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8436): Process ended prematurely: osmo-stp_10.42.42.5(pid=8436) [trial-2374↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8436)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8450): Process ended prematurely: osmo-stp_10.42.42.5(pid=8450) [trial-2374↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8450)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8464): Process ended prematurely: osmo-stp_10.42.42.5(pid=8464) [trial-2374↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8464)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8478): Process ended prematurely: osmo-stp_10.42.42.5(pid=8478) [trial-2374↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8478)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8492): Process ended prematurely: osmo-stp_10.42.42.5(pid=8492) [trial-2374↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8492)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8506): Process ended prematurely: osmo-stp_10.42.42.5(pid=8506) [trial-2374↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8506)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8520): Process ended prematurely: osmo-stp_10.42.42.5(pid=8520) [trial-2374↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8520)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8537): Process ended prematurely: osmo-stp_10.42.42.5(pid=8537) [trial-2374↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8537)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8551): Process ended prematurely: osmo-stp_10.42.42.5(pid=8551) [trial-2374↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8551)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8566): Process ended prematurely: osmo-stp_10.42.42.5(pid=8566) [trial-2374↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8566)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8580): Process ended prematurely: osmo-stp_10.42.42.5(pid=8580) [trial-2374↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8580)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8594): Process ended prematurely: osmo-stp_10.42.42.5(pid=8594) [trial-2374↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8594)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8608): Process ended prematurely: osmo-stp_10.42.42.5(pid=8608) [trial-2374↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8608)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8622): Process ended prematurely: osmo-stp_10.42.42.5(pid=8622) [trial-2374↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8622)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8636): Process ended prematurely: osmo-stp_10.42.42.5(pid=8636) [trial-2374↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8636)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8650): Process ended prematurely: osmo-stp_10.42.42.5(pid=8650) [trial-2374↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8650)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8664): Process ended prematurely: osmo-stp_10.42.42.5(pid=8664) [trial-2374↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8664)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8678): Process ended prematurely: osmo-stp_10.42.42.5(pid=8678) [trial-2374↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8678)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8692): Process ended prematurely: osmo-stp_10.42.42.5(pid=8692) [trial-2374↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8692)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8706): Process ended prematurely: osmo-stp_10.42.42.5(pid=8706) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8706)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8722): Process ended prematurely: osmo-stp_10.42.42.5(pid=8722) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8722)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8736): Process ended prematurely: osmo-stp_10.42.42.5(pid=8736) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8736)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8750): Process ended prematurely: osmo-stp_10.42.42.5(pid=8750) [trial-2374↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8750)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8764): Process ended prematurely: osmo-stp_10.42.42.5(pid=8764) [trial-2374↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8764)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9050): Process ended prematurely: osmo-stp_10.42.42.5(pid=9050) [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9050)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9064): Process ended prematurely: osmo-stp_10.42.42.5(pid=9064) [trial-2374↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9064)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9078): Process ended prematurely: osmo-stp_10.42.42.5(pid=9078) [trial-2374↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9078)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9094): Process ended prematurely: osmo-stp_10.42.42.5(pid=9094) [trial-2374↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9094)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9109): Process ended prematurely: osmo-stp_10.42.42.5(pid=9109) [trial-2374↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] + rm -rf trial-2374/inst + cd trial-2374 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 11:14:59 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374-run.tgz run.2022-12-10_11-15-10 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2956.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29270.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30048.tgz osmo-stp.build-9242.tgz osmo-trx.build-4677.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE